-- Logs begin at Wed 2022-05-18 14:03:10 UTC, end at Wed 2022-05-18 15:14:08 UTC. -- May 18 14:46:25.711082 dv-cinder-839987-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 14:46:25.719559 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 14:46:25 2022] *** May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: nodename: dv-cinder-839987-7-iscsi May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: machine: x86_64 May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: clock source: unix May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: pcre jit disabled May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: detected number of CPU cores: 4 May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: current working directory: / May 18 14:46:25.721562 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: detected binary path: /usr/bin/uwsgi-core May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: your processes number limit is 47680 May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: your memory page size is 4096 bytes May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: detected max file descriptor number: 2048 May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: lock engine: pthread robust mutexes May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: thunder lock: enabled May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 14:46:25.722244 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 14:46:25.765842 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: Python main interpreter initialized at 0x56425abc59c0 May 18 14:46:25.765842 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: python threads support enabled May 18 14:46:25.765842 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: your server socket listen backlog is limited to 100 connections May 18 14:46:25.765842 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: your mercy for graceful operations on workers is 90 seconds May 18 14:46:25.766715 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: mapped 403077 bytes (393 KB) for 2 cores May 18 14:46:25.766796 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: *** Operational MODE: preforking *** May 18 14:46:25.767047 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: *** uWSGI is running in multiple interpreter mode *** May 18 14:46:25.767047 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: spawned uWSGI master process (pid: 109417) May 18 14:46:25.767217 dv-cinder-839987-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 14:46:25.770754 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: spawned uWSGI worker 1 (pid: 109418, cores: 1) May 18 14:46:25.770754 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: spawned uWSGI worker 2 (pid: 109419, cores: 1) May 18 14:46:25.770754 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 14:46:26.968721 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 14:46:27.003185 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 14:46:27.704645 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:46:27.704645 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: from cryptography.utils import int_from_bytes May 18 14:46:27.704960 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:46:27.704960 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: from cryptography.utils import int_from_bytes May 18 14:46:27.707455 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:46:27.707455 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: from cryptography.utils import int_from_bytes May 18 14:46:27.707773 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:46:27.707773 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: from cryptography.utils import int_from_bytes May 18 14:46:30.297587 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 14:46:30.298209 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 14:46:30.298343 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 14:46:30.298699 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 14:46:30.298952 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 14:46:30.299332 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.299553 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 14:46:30.299915 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.300000 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 14:46:30.300086 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.300257 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.300356 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 14:46:30.300610 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.300713 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 14:46:30.300914 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.301001 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 14:46:30.301232 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.301319 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.301561 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.301704 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.301880 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.301979 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.302137 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.302235 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.302446 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.302549 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.302765 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-7-iscsi {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.302876 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303081 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303189 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303383 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303485 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303688 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303795 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.303998 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.304092 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.304295 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.304397 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.304630 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.304747 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-7-iscsi {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.304934 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.305022 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.305249 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.305427 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.305565 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.305863 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.305959 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.306169 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.306273 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.306477 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.306568 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.306779 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.306887 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.307106 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.307282 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.307409 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.307593 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.307726 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.307895 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.308078 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.308206 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.308334 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.308544 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.308659 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.308882 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.309041 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-7-iscsi {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.309215 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.309354 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.309502 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.309661 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.309923 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.310011 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.310253 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.310363 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.310566 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.310672 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.310960 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-7-iscsi {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311054 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311276 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311386 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311589 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311719 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311890 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.311983 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.312211 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.312348 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.312529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.312678 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.313392 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.313489 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.313705 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.313818 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314002 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314109 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314310 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314414 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314615 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314712 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.314929 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315016 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315230 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315325 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315530 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315630 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315776 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.315864 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.316079 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.316172 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.316395 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.316491 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.316734 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.316826 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317046 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317292 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317380 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317571 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317721 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317848 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.317949 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.318164 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.318252 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.318467 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.318554 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.318769 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.318869 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319028 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319125 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319280 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319368 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319605 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319694 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.319925 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320018 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320221 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320307 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320521 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320651 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320851 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.320937 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.321157 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.321243 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.321460 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.321547 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.321761 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.321892 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322063 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322156 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322369 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322457 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322686 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322773 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.322983 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.323076 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.323302 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.323389 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.323609 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.323704 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.323910 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324009 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324222 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324317 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324536 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324653 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324865 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.324965 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.325166 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.325252 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.325464 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.325595 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.325778 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.325874 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326095 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326188 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326392 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326476 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326639 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326740 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.326935 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327030 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327236 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327324 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327546 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327645 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327845 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.327938 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.328144 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.328283 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.328991 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329137 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329291 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329379 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329590 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329684 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329891 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.329979 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.330190 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.330279 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.330491 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.330580 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.330792 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.330880 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331089 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331175 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331387 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331480 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331689 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331781 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.331991 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.332084 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.332292 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.332391 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.332617 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.332734 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.332921 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333027 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333223 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333331 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333521 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333619 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333820 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.333917 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.334131 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.334236 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.334431 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.334557 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.334731 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.334828 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335031 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335203 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335333 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335442 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335633 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335729 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.335943 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336044 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336244 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336340 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336539 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336653 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336878 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.336982 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.337174 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.337260 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.337476 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.337561 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.337784 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.337878 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338086 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338172 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338383 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338468 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338681 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338785 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.338978 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339063 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339274 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339359 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339573 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339661 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339871 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.339971 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.340168 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.340255 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.340462 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.340557 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.340785 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.340885 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341088 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341219 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341391 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341477 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341689 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341774 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.341991 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.342085 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.342286 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.342387 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.342604 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.342691 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.342922 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.343018 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.343229 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.343316 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.343534 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.343621 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.343838 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.343932 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.344179 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:46:30.344265 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.344498 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.344618 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.344831 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.344937 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.345141 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.345236 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.345463 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.345550 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.345772 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.345867 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.346078 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.346165 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.346386 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.346479 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.346700 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.346787 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347013 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347099 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347332 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347417 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347644 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.347951 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348061 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348264 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348351 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348570 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348723 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348906 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.348994 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.349230 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.349315 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.349546 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.349642 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.349850 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.349945 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.350174 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.350266 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.350486 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.350574 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.350804 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.350890 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.351121 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.351217 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.351438 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.351525 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.351745 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.351831 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.352061 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.352369 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.352455 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.352710 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.352997 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.353095 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.353339 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.353578 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.353666 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.353952 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.354189 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.354284 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.354557 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.354790 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.354881 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.355159 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.355334 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.355490 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.355802 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.355932 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.356115 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.356424 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.356517 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.356765 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.357075 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.357161 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.357384 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.357682 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.357775 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.357979 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.358226 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.358373 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.358574 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.358824 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.358911 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.359199 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.359299 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.359511 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.359605 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.359853 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.359939 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.360178 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.360275 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.360524 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.360703 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.360878 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.361077 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.361207 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.361419 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.361528 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.361732 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.361852 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.362044 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.362172 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.362376 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.362548 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.362692 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.362839 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.363099 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.363263 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.363421 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.363572 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.363697 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.363798 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.364013 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.364110 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.364322 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.364409 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.364670 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.364774 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365005 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365101 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365316 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365403 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365622 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365717 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.365937 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366025 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366248 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366334 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366554 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366640 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366863 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.366952 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.367169 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.367254 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.367483 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.367577 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.367794 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.367883 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.368099 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.368184 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.368424 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.368520 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.368762 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.368851 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.369073 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.369159 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.369390 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.369488 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.369701 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.369799 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370008 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370095 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370306 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370401 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370616 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370703 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.370918 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371005 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371220 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371316 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371520 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371607 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371828 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.371924 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.372129 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.372228 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.372492 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.372642 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.372757 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.372845 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373059 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373155 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373358 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373445 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373674 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373761 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.373979 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374068 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374278 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374365 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374577 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374664 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374875 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.374962 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.375684 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.375787 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376014 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376112 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376316 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376402 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376650 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376741 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.376957 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377060 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377264 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377350 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377569 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377655 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377875 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.377976 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.378179 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.378265 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.378490 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.378578 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.378798 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.378897 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.379104 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.379196 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.379419 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.379544 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.379708 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.379803 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380019 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380112 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380325 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380412 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380667 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380757 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.380979 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.381064 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.381311 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.381405 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.381592 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.381687 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.381905 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382000 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382235 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382322 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382554 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382671 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382868 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.382970 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.383182 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.383290 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.383484 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.383581 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.383795 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.383891 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.384101 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.384207 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.384407 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.384505 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.384740 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.384836 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385047 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385167 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385357 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385462 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385662 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385749 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.385968 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386083 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386274 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386368 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386590 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386679 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386895 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.386993 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.387211 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.387299 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.387510 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.387608 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.387820 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.387919 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.388131 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.388226 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.388441 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.388531 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.388775 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.388879 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.389086 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.389192 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.389395 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.389482 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.389698 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.389785 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.390002 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.390089 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.390308 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.390403 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.390609 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.390697 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.391523 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.391753 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.391840 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.392072 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.392160 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.392393 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.392489 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.392721 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.392824 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393038 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393134 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393346 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393432 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393652 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393739 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.393954 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394042 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394252 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394348 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394557 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394651 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394873 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.394961 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.395179 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.395261 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.395492 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.395596 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.395793 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.395879 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.396094 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.396180 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.396397 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.396506 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.396729 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.396816 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397040 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397128 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397340 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397436 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397639 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397735 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.397938 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398026 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398244 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398344 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398549 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398853 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.398941 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.399165 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.399264 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.399479 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.399573 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.399785 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.399880 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.400096 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.400185 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.400405 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.400495 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.400728 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.400819 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401042 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401131 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401352 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401439 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401658 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401751 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.401960 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402047 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402262 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402348 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402566 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402654 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402870 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.402957 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.403187 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.403274 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.403492 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.403588 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.403794 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.403880 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.404099 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.404186 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.404399 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.404496 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.404728 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.404821 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.405039 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.405125 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.405352 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.405601 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.405690 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.405930 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.406017 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.406242 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.406328 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.406600 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.406736 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.406921 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407008 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407236 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407338 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407560 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407646 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407881 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.407972 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.408188 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.408291 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.408501 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.408646 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.408830 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.408928 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.409132 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.409234 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.409434 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.409532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.409738 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.409828 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.410039 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.410295 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.410393 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.410623 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.410709 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.410927 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411037 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411227 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411359 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411527 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411680 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411824 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.411997 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.412124 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.412328 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.412439 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.412676 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.412770 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413028 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413133 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413338 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413437 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413648 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413735 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.413951 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414046 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414243 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414332 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414542 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414629 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414840 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.414927 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.415143 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.415231 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.415447 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.415535 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.415755 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.415849 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416059 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416148 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416363 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416449 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416695 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416805 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.416999 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.417087 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.417315 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.417412 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.417626 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.417765 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.417913 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418002 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418213 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418301 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418519 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418616 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418824 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.418913 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.419122 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.419208 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.419424 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.419576 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.419734 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.419823 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420038 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420133 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420343 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420433 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420671 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420808 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.420980 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.421099 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.421545 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.421706 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.421854 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.422015 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.422670 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.422839 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.422977 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.423165 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.423277 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.423473 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.423572 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.423779 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.423880 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.424082 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.424170 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.424395 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.424489 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.424730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.424820 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425038 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425125 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425341 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425438 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425642 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425731 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.425942 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426031 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426247 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426341 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426548 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426845 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.426930 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.427147 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.427232 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.427452 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.427577 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.427750 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.427837 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428051 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428146 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428352 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428438 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428672 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428765 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.428974 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429075 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429278 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429364 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429588 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429683 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429895 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.429991 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.430191 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.430278 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.430494 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.430590 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.430795 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.430897 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431095 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431183 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431392 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431487 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431694 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431790 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.431991 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432085 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432287 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432374 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432616 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432708 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432908 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.432995 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.433205 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.433303 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.433510 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.433598 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.433807 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.433901 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.434106 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.434193 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.434405 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.434500 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.434700 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.434796 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435020 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435115 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435324 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435412 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435633 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435767 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.435935 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436033 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436242 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436330 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436544 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436661 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436874 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.436973 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.437172 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.437266 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.437475 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.437562 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.438283 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.438386 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.438597 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.438684 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.438900 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.438987 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.439216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.439311 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.439518 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.439614 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.439820 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.439925 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.440125 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.440215 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.440427 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.440522 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.440758 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.440848 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.441075 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.441163 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.441391 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.441481 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.441709 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.441796 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442010 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442100 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442314 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442401 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442623 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442715 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.442925 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443013 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443228 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443322 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443528 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443623 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443829 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.443914 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.444136 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.444222 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.444443 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.444539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.444768 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.444856 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445071 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445157 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445385 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445483 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445691 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445778 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.445997 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.446091 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.446294 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.446389 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.446612 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.446700 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.446918 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447020 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447217 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447306 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447521 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447604 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447820 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.447908 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.448126 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.448214 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.448423 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.448509 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.448757 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.448878 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.449068 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.449186 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.449381 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.449497 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.449691 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.449786 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450002 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450093 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450396 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450616 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450714 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.450926 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451013 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451234 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451330 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451545 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451642 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451868 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.451956 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.452177 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.452271 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.452480 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.452576 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.452815 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.452914 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.453120 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.453215 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.453445 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.453540 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.453748 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.453834 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454050 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454171 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454349 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454482 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454649 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454792 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.454964 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.455097 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.455264 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.455408 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.455577 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.455717 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.455987 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.456081 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.456292 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.456388 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.456607 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.456709 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457023 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457119 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457331 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457420 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457637 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457723 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.457943 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458042 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458248 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458335 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458554 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458648 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458850 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.458948 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.459159 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.459246 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.459461 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.459546 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.459765 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.459862 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.460070 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.460160 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.460371 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.460458 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.460701 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.460805 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461004 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461100 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461321 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461409 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461639 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461736 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.461946 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.462042 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.462315 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.462417 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.462674 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.462762 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.462990 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.463080 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.463296 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.463383 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.463613 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.463707 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.463932 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464027 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464230 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464325 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464688 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464860 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.464956 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.465158 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.465253 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.465457 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.465545 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.465773 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.465862 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466071 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466165 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466374 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466469 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466674 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466760 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.466977 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467072 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467276 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467379 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467575 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467664 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467890 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.467986 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.468187 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.468313 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.468502 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.468645 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.468840 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.468988 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.469181 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.469319 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.469497 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.469628 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.469797 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.469935 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.470111 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.470246 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.470414 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.470551 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.470713 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.470856 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471035 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471168 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471333 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471475 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471667 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471784 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.471977 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.472094 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.472293 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.472404 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.472639 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.472732 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.472967 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.473056 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.473273 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.473368 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.473600 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.473696 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.473921 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474017 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474232 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474319 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474544 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474640 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474864 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.474952 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.475162 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.475260 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.475461 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.475558 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.475765 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.475854 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476064 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476192 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476363 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476461 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476685 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476774 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.476989 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477074 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477286 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477375 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477582 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477674 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477879 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.477975 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.478194 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.478284 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.478494 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.478582 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.478807 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.478902 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.479110 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.479208 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.479408 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.479495 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.479706 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.479810 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480005 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480095 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480340 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480437 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480662 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480801 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.480977 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481063 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481284 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481373 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481596 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481691 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481901 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.481988 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.482210 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.482300 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.482513 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.482612 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.482817 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.482906 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.483120 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.483207 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.483426 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.483521 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.483732 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.483818 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.484039 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.484124 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.484347 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.484437 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.485175 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.485285 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.485489 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.485583 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.485791 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.485879 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.486101 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.486187 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.486418 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.486509 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.486748 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.486932 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.487065 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.487262 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.487386 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.487575 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.487716 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.487888 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488012 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488200 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488337 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488509 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488676 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488844 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.488994 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.489153 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.489311 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.489462 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.489628 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.489771 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.489946 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.490079 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.490262 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.490404 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.490578 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.490706 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.490889 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491027 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491206 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491356 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491521 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491669 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491847 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.491981 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.492297 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.492385 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.492637 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.492729 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.492985 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.493076 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.493296 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.493386 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.493599 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.493695 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.493910 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494011 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494221 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494309 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494531 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494618 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494837 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.494932 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.495142 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.495237 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.495450 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.495544 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.495757 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.495916 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.496063 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.496159 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.496367 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.496455 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.496710 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.496801 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497021 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497109 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497339 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497427 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497654 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497750 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.497970 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498057 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498278 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498373 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498586 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498686 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498896 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.498986 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.499223 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.499408 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.499539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.499720 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.499854 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.500047 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.500166 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.500994 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.501106 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.501322 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.501411 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.501636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.501724 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.501950 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502047 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502277 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502365 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502586 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502681 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502889 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.502983 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.503200 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.503296 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.503507 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.503612 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.503806 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.503900 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.504125 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.504214 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.504432 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.504529 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.504758 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.504847 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.505074 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.505280 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.505378 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.505605 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.505893 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.505982 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.506234 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.506331 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.506546 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.506643 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.506863 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.506958 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.507183 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.507270 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.507495 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.507593 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.507797 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.507892 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.508101 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.508228 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.508401 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.508489 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.508728 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.508820 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509033 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509131 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509337 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509425 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509735 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.509935 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.510032 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.510241 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.510336 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.510550 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.510636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.510847 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.511082 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.511172 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.511427 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.511525 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.511744 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.511840 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512047 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512136 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512352 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512440 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512674 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512777 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.512983 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.513072 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.513282 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.513396 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.513583 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.513705 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.513894 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514007 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514178 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514483 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514626 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514781 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.514948 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515090 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515238 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515370 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515548 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515675 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515901 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.515996 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.516211 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.516308 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.516523 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.516683 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.516855 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.516943 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.517182 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.517278 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.517489 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.517621 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.517795 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.517904 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.518101 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.518207 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.518412 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.518511 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.518714 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.518808 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519016 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519111 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519321 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519417 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519626 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519715 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.519939 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.520158 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.520246 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.520491 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.520648 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.520838 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.520939 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.521152 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.521239 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.521457 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.521546 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.521769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.521865 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.522069 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.522157 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.522379 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.522467 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.522700 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.522796 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523008 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523095 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523312 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523446 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523620 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523736 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.523923 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524020 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524228 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524316 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524532 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524641 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524864 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.524952 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.525170 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.525258 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.525477 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.525719 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.525807 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.526057 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.526145 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.526360 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.526448 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.526669 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.526757 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527002 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527089 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527306 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527393 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527613 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527707 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.527919 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528006 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528230 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528321 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528536 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528645 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528867 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.528956 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.529172 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.529271 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.529476 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.529565 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.529783 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.529878 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.530093 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.530189 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.530406 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.530495 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.530706 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.530802 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531012 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531101 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531322 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531419 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531666 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531774 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.531987 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.532075 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.532303 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.532391 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.532662 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.532754 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.532983 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533069 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533287 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533601 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533689 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533906 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.533992 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.534213 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.534300 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.534523 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.534613 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.534833 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.534921 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.535160 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.535254 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.535461 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.535549 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.535760 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.535848 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.536061 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.536158 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.536365 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.536460 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.536711 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.536841 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537018 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537119 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537319 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537415 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537617 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537706 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.537922 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538014 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538221 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538316 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538520 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538633 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538819 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.538953 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.539117 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.539253 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.539421 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.539564 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.539719 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.539891 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540016 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540230 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540319 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540560 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540685 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540907 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.540995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.541202 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.541289 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.541507 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.541612 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.541804 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.541893 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.542103 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.542192 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.542406 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.542496 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.542705 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.542793 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543090 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543301 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543397 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543612 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543700 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.543918 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544014 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544222 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544311 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544523 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544639 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544853 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.544949 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.545158 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.545245 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.545458 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.545552 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.545764 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.545868 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.546069 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.546165 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.546636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.546725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.546938 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.547033 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.547765 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.547862 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.548077 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.548174 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.548379 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.548468 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.548707 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.548813 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549013 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549101 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549319 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549408 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549639 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549735 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.549957 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550045 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550257 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550346 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550575 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550663 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550887 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.550975 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.551194 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.551281 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.551500 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.551596 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.551805 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.551901 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.552121 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.552209 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.552423 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.552510 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.552755 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.552859 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553064 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553152 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553367 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553464 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553672 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.553981 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554067 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554285 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554372 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554591 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554681 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554900 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.554988 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.555200 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.555292 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.555518 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.555608 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.555836 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.555923 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.556138 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.556224 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.556464 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.556552 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.556807 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.556898 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.557130 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.557239 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.557434 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.557530 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.557741 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.557827 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.558039 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.558133 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.558277 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 14:46:30.558365 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.558657 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.558973 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.559281 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.559592 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.559907 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.560223 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.560549 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.560895 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.561204 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.561527 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.562007 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.562370 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.562686 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.563080 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.563410 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.563726 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.564039 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.564344 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:46:30.564606 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 14:46:30.617703 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO dbcounter [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Registered counter for database nova_api May 18 14:46:30.624225 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO dbcounter [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Registered counter for database nova_api May 18 14:46:30.639216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_db.sqlalchemy.engines [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.644408 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_db.sqlalchemy.engines [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.646301 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writer thread running {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.650686 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writer thread running {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.701159 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.context [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aee4120-6738-4344-ac0e-c12b2bd21945(cell1) {{(pid=109419) load_cells /opt/stack/nova/nova/context.py:464}} May 18 14:46:30.706448 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.context [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aee4120-6738-4344-ac0e-c12b2bd21945(cell1) {{(pid=109418) load_cells /opt/stack/nova/nova/context.py:464}} May 18 14:46:30.707043 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_concurrency.lockutils [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:46:30.708710 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_concurrency.lockutils [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:46:30.709493 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_concurrency.lockutils [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:46:30.711454 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_concurrency.lockutils [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:46:30.711831 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:46:30.713484 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:46:30.713609 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO dbcounter [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Registered counter for database nova_cell0 May 18 14:46:30.714322 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:46:30.716293 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:46:30.717461 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO dbcounter [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Registered counter for database nova_cell1 May 18 14:46:30.718294 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO dbcounter [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Registered counter for database nova_cell0 May 18 14:46:30.723510 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO dbcounter [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Registered counter for database nova_cell1 May 18 14:46:30.725892 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_db.sqlalchemy.engines [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.727198 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_db.sqlalchemy.engines [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.730002 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_db.sqlalchemy.engines [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.733694 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writer thread running {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.734875 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_db.sqlalchemy.engines [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.735495 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writer thread running {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.735741 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writer thread running {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.875852 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writer thread running {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.878471 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO dbcounter [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Registered counter for database nova_cell0 May 18 14:46:30.884737 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO dbcounter [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Registered counter for database nova_cell0 May 18 14:46:30.887237 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG oslo_db.sqlalchemy.engines [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.892142 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writer thread running {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:30.893071 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_db.sqlalchemy.engines [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:46:30.897310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writer thread running {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:46:31.224863 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: WARNING keystonemiddleware.auth_token [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:46:31.226159 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: WARNING keystonemiddleware.auth_token [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:46:31.232167 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: WARNING keystonemiddleware.auth_token [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:46:31.233464 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: WARNING keystonemiddleware.auth_token [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:46:31.575421 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: WARNING keystonemiddleware.auth_token [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:46:31.578914 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: WARNING keystonemiddleware.auth_token [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:46:31.582404 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: WARNING keystonemiddleware.auth_token [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:46:31.585124 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: WARNING keystonemiddleware.auth_token [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:46:31.587656 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56425abc59c0 pid: 109419 (default app) May 18 14:46:31.589727 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:46:31.590397 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56425abc59c0 pid: 109418 (default app) May 18 14:46:31.590925 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-de80134c-f415-47cc-8cb4-002add701e37 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 May 18 14:46:31.591330 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Wed May 18 14:46:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:47:49.536412 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:47:49.537736 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 May 18 14:47:49.538131 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:47:49.549613 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writing DB stats nova_api:SELECT=3 {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:49.550748 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writing DB stats nova_cell1:SELECT=3 {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:49.551846 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writing DB stats nova_cell0:SELECT=3 {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:49.552914 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:50.022017 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-8a97040f-829d-41fa-9b4a-8fcf4cf6bb0a admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:47:50.054123 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-8a97040f-829d-41fa-9b4a-8fcf4cf6bb0a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.510083 May 18 14:47:50.054889 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1291 bytes} [Wed May 18 14:47:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:47:52.347163 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:47:52.351173 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-4e688835-da33-41c2-877b-26cf8aef079f None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004381 May 18 14:47:52.352097 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 2/4] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:47:52.416866 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-effc111a-d849-4c03-88ef-613c13b31105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:47:52.436294 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:47:52.436294 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: warnings.warn(msg) May 18 14:47:52.469058 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-effc111a-d849-4c03-88ef-613c13b31105 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110261 May 18 14:47:52.469823 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 3/5] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:47:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:47:52.708155 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-63b60847-1102-4de7-be05-997f5208e0b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:47:52.710616 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:47:52.710616 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: warnings.warn(msg) May 18 14:47:52.713302 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_api:SELECT=3 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:52.714278 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_cell0:SELECT=3 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:52.715123 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_cell1:SELECT=3 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:52.715875 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:52.776304 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-63b60847-1102-4de7-be05-997f5208e0b4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298367 May 18 14:47:52.777015 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 3/6] 10.222.0.59 () {64 vars in 1335 bytes} [Wed May 18 14:47:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:47:55.172835 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-effc111a-d849-4c03-88ef-613c13b31105 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:47:55.174342 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-effc111a-d849-4c03-88ef-613c13b31105 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 May 18 14:47:55.175073 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 4/7] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:47:55.282804 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-92c319d8-baf6-42c6-8df6-572601edb798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:47:55.300693 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:47:55.300693 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: warnings.warn(msg) May 18 14:47:55.319877 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-92c319d8-baf6-42c6-8df6-572601edb798 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138400 May 18 14:47:55.320450 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 4/8] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:47:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:47:55.332944 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-e74a1189-4249-41b0-929f-8b901332f564 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:47:55.334642 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:47:55.334642 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: warnings.warn(msg) May 18 14:47:55.369652 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-e74a1189-4249-41b0-929f-8b901332f564 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040825 May 18 14:47:55.370326 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 5/9] 10.222.0.59 () {64 vars in 1335 bytes} [Wed May 18 14:47:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:47:57.661373 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-92c319d8-baf6-42c6-8df6-572601edb798 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:47:57.662402 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-92c319d8-baf6-42c6-8df6-572601edb798 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 18 14:47:57.662989 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:47:57.722889 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-f488ecb3-5d62-4640-aa85-50711aade1e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:47:57.741360 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-f488ecb3-5d62-4640-aa85-50711aade1e5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072840 May 18 14:47:57.742141 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 6/11] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:47:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:47:57.754284 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-e77252dd-8965-47ef-9631-e5b3cab25072 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:47:57.778718 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-e77252dd-8965-47ef-9631-e5b3cab25072 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027548 May 18 14:47:57.779896 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 6/12] 10.222.0.59 () {64 vars in 1335 bytes} [Wed May 18 14:47:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:48:00.083902 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-f488ecb3-5d62-4640-aa85-50711aade1e5 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:00.084961 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-f488ecb3-5d62-4640-aa85-50711aade1e5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 18 14:48:00.085368 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 7/13] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:00.145713 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-2b957c04-bb66-4484-b9fc-641b80b6ef6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "name": "ds2G", "id": "d3", "vcpus": 2}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:00.164842 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-2b957c04-bb66-4484-b9fc-641b80b6ef6f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072784 May 18 14:48:00.165400 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 7/14] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:48:00.177925 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-248cddbf-0cd2-48ec-a0d0-2291ee42fddb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:00.201649 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-248cddbf-0cd2-48ec-a0d0-2291ee42fddb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027284 May 18 14:48:00.202231 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 8/15] 10.222.0.59 () {64 vars in 1335 bytes} [Wed May 18 14:48:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:48:02.490953 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-2b957c04-bb66-4484-b9fc-641b80b6ef6f admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:02.491887 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-2b957c04-bb66-4484-b9fc-641b80b6ef6f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 18 14:48:02.492494 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 8/16] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:02.553055 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-1798966b-60b7-4d74-82cf-f68c868cef00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:02.572016 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-1798966b-60b7-4d74-82cf-f68c868cef00 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073264 May 18 14:48:02.572783 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 9/17] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:48:02.585398 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-2d3b8325-f91b-4605-8ff6-b40533d2653d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:02.609621 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-2d3b8325-f91b-4605-8ff6-b40533d2653d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027858 May 18 14:48:02.610439 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 9/18] 10.222.0.59 () {64 vars in 1335 bytes} [Wed May 18 14:48:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:48:04.859771 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-1798966b-60b7-4d74-82cf-f68c868cef00 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:04.860848 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-1798966b-60b7-4d74-82cf-f68c868cef00 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 18 14:48:04.861264 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 10/19] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:04.924419 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-bf395043-4d12-4025-92a0-21316f9c213b admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:04.947637 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-bf395043-4d12-4025-92a0-21316f9c213b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079446 May 18 14:48:04.948184 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 10/20] 10.222.0.59 () {60 vars in 1291 bytes} [Wed May 18 14:48:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:48:07.449452 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-1798966b-60b7-4d74-82cf-f68c868cef00 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:07.450983 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-1798966b-60b7-4d74-82cf-f68c868cef00 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 May 18 14:48:07.451380 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 11/21] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:07.515976 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-44051e43-f2ed-4317-97c2-6a549bdfce4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:07.533921 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-44051e43-f2ed-4317-97c2-6a549bdfce4a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076672 May 18 14:48:07.534469 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 11/22] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:48:07.547791 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-12fcdbfb-046f-48c1-93dc-c80be3d37682 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:07.574060 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-12fcdbfb-046f-48c1-93dc-c80be3d37682 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031255 May 18 14:48:07.575218 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 12/23] 10.222.0.59 () {64 vars in 1332 bytes} [Wed May 18 14:48:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:48:10.325576 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-44051e43-f2ed-4317-97c2-6a549bdfce4a admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:10.326983 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-44051e43-f2ed-4317-97c2-6a549bdfce4a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 May 18 14:48:10.327452 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:10.391518 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-e217e3a6-0531-4c8a-81d5-97571f9a21fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:10.411309 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-e217e3a6-0531-4c8a-81d5-97571f9a21fc admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078082 May 18 14:48:10.411869 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 13/25] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:48:10.424426 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-4d67d681-1ea3-42d0-b792-38fa0900ed5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:10.449066 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-4d67d681-1ea3-42d0-b792-38fa0900ed5d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028681 May 18 14:48:10.449908 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 13/26] 10.222.0.59 () {64 vars in 1332 bytes} [Wed May 18 14:48:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:48:13.016155 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-e217e3a6-0531-4c8a-81d5-97571f9a21fc admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:13.017290 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-e217e3a6-0531-4c8a-81d5-97571f9a21fc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 May 18 14:48:13.017693 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 14/27] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:13.077469 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-c1e7c4c6-20be-4def-b2ed-7e4d7c381062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:13.097061 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-c1e7c4c6-20be-4def-b2ed-7e4d7c381062 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073439 May 18 14:48:13.097622 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 14/28] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:48:13.110057 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-41e663ab-2e34-4d4a-a2b1-e6f022a2561f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:13.131899 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-41e663ab-2e34-4d4a-a2b1-e6f022a2561f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026050 May 18 14:48:13.132483 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 15/29] 10.222.0.59 () {64 vars in 1332 bytes} [Wed May 18 14:48:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:48:15.384285 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-c1e7c4c6-20be-4def-b2ed-7e4d7c381062 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:15.385410 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-c1e7c4c6-20be-4def-b2ed-7e4d7c381062 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 18 14:48:15.385814 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 15/30] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:15.452289 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-be9233b3-7ec7-4aa0-9770-2ace39e2728c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4"}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:15.471494 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-be9233b3-7ec7-4aa0-9770-2ace39e2728c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079477 May 18 14:48:15.479012 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 16/31] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:48:15.484284 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-3d3b85c6-2867-49ac-943e-9d4b59597216 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:15.513030 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-3d3b85c6-2867-49ac-943e-9d4b59597216 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032566 May 18 14:48:15.513712 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 16/32] 10.222.0.59 () {64 vars in 1332 bytes} [Wed May 18 14:48:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:48:17.858497 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-be9233b3-7ec7-4aa0-9770-2ace39e2728c admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:17.859749 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-be9233b3-7ec7-4aa0-9770-2ace39e2728c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 May 18 14:48:17.860373 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 17/33] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:17.927410 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-5665f373-d904-44d1-b3a1-87f6ac95eb40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:17.950925 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-5665f373-d904-44d1-b3a1-87f6ac95eb40 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084663 May 18 14:48:17.951917 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 17/34] 10.222.0.59 () {64 vars in 1282 bytes} [Wed May 18 14:48:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:48:17.963789 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-c6f0418f-6e52-4b74-aeb5-bf86e0a47d0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:17.992293 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-c6f0418f-6e52-4b74-aeb5-bf86e0a47d0a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032248 May 18 14:48:17.993636 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 18/35] 10.222.0.59 () {64 vars in 1332 bytes} [Wed May 18 14:48:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:48:41.964105 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-5665f373-d904-44d1-b3a1-87f6ac95eb40 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:41.965133 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-5665f373-d904-44d1-b3a1-87f6ac95eb40 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 18 14:48:41.965519 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 18/36] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:41.975798 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:42.029894 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-df0309c1-2953-44e0-8c6e-9eb02b752e34 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:42.050349 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-df0309c1-2953-44e0-8c6e-9eb02b752e34 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079046 May 18 14:48:42.050884 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 19/37] 10.222.0.59 () {60 vars in 1291 bytes} [Wed May 18 14:48:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:48:43.060935 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-5665f373-d904-44d1-b3a1-87f6ac95eb40 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:43.061925 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-5665f373-d904-44d1-b3a1-87f6ac95eb40 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 18 14:48:43.062326 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 19/38] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:43.265432 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-2e3db4e2-3271-4819-ae7c-d0d58cfbc5b9 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:43.270907 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.wsgi [None req-2e3db4e2-3271-4819-ae7c-d0d58cfbc5b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-2e3db4e2-3271-4819-ae7c-d0d58cfbc5b9 admin admin] Request method failure captured: May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Accept: application/json May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Accept-Encoding: gzip, deflate May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Connection: keep-alive May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Content-Length: 0 May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Host: 10.222.0.59 May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Openstack-Api-Version: compute 2.90 May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Openstack-System-Scope: None May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: User-Agent: python-novaclient May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Auth-Token: gAAAAABihQdLdcANcX5IJ479wwontrkA6OGqSpk5JdlXQwbJoCk-Wb2o6U0CvegM_FGRz4p-bvXeIiybnlh4qVPky1QPxJ7nijIIkzMhJKj4MIZ47hnFr5tjTzFD1raZCBiyQ2YqPTOgk0Zdm9Lo3VapVNjv_BLS2hajiw7EixRm55mH-W2mDkM May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Domain-Id: None May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Domain-Name: None May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Identity-Status: Confirmed May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Is-Admin-Project: True May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Openstack-Nova-Api-Version: 2.90 May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Domain-Id: default May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Domain-Name: Default May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Name: admin May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Role: reader,member,admin May 18 14:48:43.274259 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Roles: reader,member,admin May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant: admin May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant-Name: admin May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User: admin May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Domain-Id: default May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Domain-Name: Default May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Id: 6bb17e1228d44efb843bda521c27b495 May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Name: admin May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: method: > May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: exception: Flavor 42 could not be found. May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: action_args: {'id': '42'} May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:48:43.275953 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:43.277216 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:43.278657 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-2e3db4e2-3271-4819-ae7c-d0d58cfbc5b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:48:43.279952 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-2e3db4e2-3271-4819-ae7c-d0d58cfbc5b9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061342 May 18 14:48:43.279952 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 20/39] 10.222.0.59 () {60 vars in 1190 bytes} [Wed May 18 14:48:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 14:48:43.285155 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-8cbdebe5-5171-4bc2-989f-147c32458048 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:43.288001 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:43.308886 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-8cbdebe5-5171-4bc2-989f-147c32458048 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027259 May 18 14:48:43.309415 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 20/40] 10.222.0.59 () {60 vars in 1210 bytes} [Wed May 18 14:48:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:48:43.319303 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-e77cebfc-55c5-4f18-930e-06fb68df4a7b admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:43.340969 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-e77cebfc-55c5-4f18-930e-06fb68df4a7b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025504 May 18 14:48:43.341521 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 21/41] 10.222.0.59 () {60 vars in 1210 bytes} [Wed May 18 14:48:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:48:43.350904 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-d2bcd788-a0e1-444e-b8ae-d1f05d184ee8 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:43.358059 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.wsgi [None req-d2bcd788-a0e1-444e-b8ae-d1f05d184ee8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-d2bcd788-a0e1-444e-b8ae-d1f05d184ee8 admin admin] Request method failure captured: May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Accept: application/json May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Accept-Encoding: gzip, deflate May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Connection: keep-alive May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Content-Length: 0 May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Host: 10.222.0.59 May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Openstack-Api-Version: compute 2.90 May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Openstack-System-Scope: None May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: User-Agent: python-novaclient May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Auth-Token: gAAAAABihQdLdcANcX5IJ479wwontrkA6OGqSpk5JdlXQwbJoCk-Wb2o6U0CvegM_FGRz4p-bvXeIiybnlh4qVPky1QPxJ7nijIIkzMhJKj4MIZ47hnFr5tjTzFD1raZCBiyQ2YqPTOgk0Zdm9Lo3VapVNjv_BLS2hajiw7EixRm55mH-W2mDkM May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Domain-Id: None May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Domain-Name: None May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Identity-Status: Confirmed May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Is-Admin-Project: True May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Openstack-Nova-Api-Version: 2.90 May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Domain-Id: default May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Domain-Name: Default May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Name: admin May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Role: reader,member,admin May 18 14:48:43.361318 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Roles: reader,member,admin May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant: admin May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant-Name: admin May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User: admin May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Domain-Id: default May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Domain-Name: Default May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Id: 6bb17e1228d44efb843bda521c27b495 May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Name: admin May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: method: > May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: exception: Flavor 42 could not be found. May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: action_args: {'id': '42'} May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:48:43.362725 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:43.363532 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:43.364858 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-d2bcd788-a0e1-444e-b8ae-d1f05d184ee8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:48:43.366083 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-d2bcd788-a0e1-444e-b8ae-d1f05d184ee8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015510 May 18 14:48:43.366083 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 21/42] 10.222.0.59 () {60 vars in 1190 bytes} [Wed May 18 14:48:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 14:48:44.237591 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-e77cebfc-55c5-4f18-930e-06fb68df4a7b admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:44.238596 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-e77cebfc-55c5-4f18-930e-06fb68df4a7b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 18 14:48:44.239303 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 22/43] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:44.427098 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-bb675ccd-0827-4c9c-ba5e-22e326cc8c8e admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:44.433488 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.wsgi [None req-bb675ccd-0827-4c9c-ba5e-22e326cc8c8e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-bb675ccd-0827-4c9c-ba5e-22e326cc8c8e admin admin] Request method failure captured: May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Accept: application/json May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Accept-Encoding: gzip, deflate May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Connection: keep-alive May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Content-Length: 0 May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Host: 10.222.0.59 May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Openstack-Api-Version: compute 2.90 May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Openstack-System-Scope: None May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: User-Agent: python-novaclient May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Auth-Token: gAAAAABihQdMVFsG8TR_wgGoajg1emiK5MB46eqA1dEromMjs9yLna5Rv2T8o_uqCQVgiW1WJb20YJhSDueHUpfF192wQcKqboUpM98T_QEupuTIEPombC-ZNysxzwxrxTHYBQ0gXvRE4hYPcM-MLae_NzKC1ME4kbi5gQbe1AufyfN0eig8yKQ May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Domain-Id: None May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Domain-Name: None May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Identity-Status: Confirmed May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Is-Admin-Project: True May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Openstack-Nova-Api-Version: 2.90 May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Domain-Id: default May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Domain-Name: Default May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Name: admin May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Role: reader,member,admin May 18 14:48:44.434980 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Roles: reader,member,admin May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant: admin May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant-Name: admin May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User: admin May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Domain-Id: default May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Domain-Name: Default May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Id: 6bb17e1228d44efb843bda521c27b495 May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Name: admin May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: method: > May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: exception: Flavor 84 could not be found. May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: action_args: {'id': '84'} May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:48:44.436498 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:44.437376 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:44.438539 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-bb675ccd-0827-4c9c-ba5e-22e326cc8c8e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:48:44.439610 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-bb675ccd-0827-4c9c-ba5e-22e326cc8c8e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062701 May 18 14:48:44.439610 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 22/44] 10.222.0.59 () {60 vars in 1190 bytes} [Wed May 18 14:48:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 14:48:44.446023 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-d7787106-5c72-450e-94c8-745a92ae63c2 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:44.460697 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-d7787106-5c72-450e-94c8-745a92ae63c2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018169 May 18 14:48:44.461172 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 23/45] 10.222.0.59 () {60 vars in 1210 bytes} [Wed May 18 14:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:48:44.470615 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-878e8cce-8c57-455f-9499-3f0210a08538 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:44.484213 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-878e8cce-8c57-455f-9499-3f0210a08538 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017183 May 18 14:48:44.484766 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 23/46] 10.222.0.59 () {60 vars in 1210 bytes} [Wed May 18 14:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:48:44.493780 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-cf9a4260-9410-4b31-bb98-06c40fe9e5ce admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:44.499607 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.wsgi [None req-cf9a4260-9410-4b31-bb98-06c40fe9e5ce admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-cf9a4260-9410-4b31-bb98-06c40fe9e5ce admin admin] Request method failure captured: May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Accept: application/json May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Accept-Encoding: gzip, deflate May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Connection: keep-alive May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Content-Length: 0 May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Host: 10.222.0.59 May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Openstack-Api-Version: compute 2.90 May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Openstack-System-Scope: None May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: User-Agent: python-novaclient May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Auth-Token: gAAAAABihQdMVFsG8TR_wgGoajg1emiK5MB46eqA1dEromMjs9yLna5Rv2T8o_uqCQVgiW1WJb20YJhSDueHUpfF192wQcKqboUpM98T_QEupuTIEPombC-ZNysxzwxrxTHYBQ0gXvRE4hYPcM-MLae_NzKC1ME4kbi5gQbe1AufyfN0eig8yKQ May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Domain-Id: None May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Domain-Name: None May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Identity-Status: Confirmed May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Is-Admin-Project: True May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Openstack-Nova-Api-Version: 2.90 May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Domain-Id: default May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Domain-Name: Default May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Name: admin May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Role: reader,member,admin May 18 14:48:44.501143 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Roles: reader,member,admin May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant: admin May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant-Name: admin May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User: admin May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Domain-Id: default May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Domain-Name: Default May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Id: 6bb17e1228d44efb843bda521c27b495 May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Name: admin May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: method: > May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: exception: Flavor 84 could not be found. May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: action_args: {'id': '84'} May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:48:44.502643 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:44.503595 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:44.504995 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-cf9a4260-9410-4b31-bb98-06c40fe9e5ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:48:44.506200 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-cf9a4260-9410-4b31-bb98-06c40fe9e5ce admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012294 May 18 14:48:44.506200 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 24/47] 10.222.0.59 () {60 vars in 1190 bytes} [Wed May 18 14:48:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 14:48:45.384412 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-878e8cce-8c57-455f-9499-3f0210a08538 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:45.385442 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-878e8cce-8c57-455f-9499-3f0210a08538 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 18 14:48:45.386341 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 24/48] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:45.570814 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-957ea22e-9b68-4636-9b63-43b104ba31b4 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:45.578493 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.wsgi [None req-957ea22e-9b68-4636-9b63-43b104ba31b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-957ea22e-9b68-4636-9b63-43b104ba31b4 admin admin] Request method failure captured: May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Accept: application/json May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Accept-Encoding: gzip, deflate May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Connection: keep-alive May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Content-Length: 0 May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Host: 10.222.0.59 May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Openstack-Api-Version: compute 2.90 May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Openstack-System-Scope: None May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: User-Agent: python-novaclient May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Auth-Token: gAAAAABihQdNK9YQ0sRHIBWwKjqNkGkL3Uc4lMjdipTxToWFR4FOuWbeKGIIy1VXV_c9tPbl2Mgr7WPnKuBFHf1pYG85GrS4qM2G69Y4l2aSxoq4d8f_zaaDgDWDPMLJRlxmWH5W6Zl8NVQlzUHV0Ewae5Hp0jxeCkP71ii0nj6TwMkp1t3AiqE May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Domain-Id: None May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Domain-Name: None May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Identity-Status: Confirmed May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Is-Admin-Project: True May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Openstack-Nova-Api-Version: 2.90 May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Domain-Id: default May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Domain-Name: Default May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Project-Name: admin May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Role: reader,member,admin May 18 14:48:45.580001 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Roles: reader,member,admin May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant: admin May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-Tenant-Name: admin May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User: admin May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Domain-Id: default May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Domain-Name: Default May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Id: 6bb17e1228d44efb843bda521c27b495 May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: X-User-Name: admin May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: method: > May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: exception: Flavor 451 could not be found. May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: action_args: {'id': '451'} May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:48:45.581529 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:45.582472 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: ERROR nova.api.openstack.wsgi May 18 14:48:45.583810 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-957ea22e-9b68-4636-9b63-43b104ba31b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:48:45.585353 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-957ea22e-9b68-4636-9b63-43b104ba31b4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061154 May 18 14:48:45.585353 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 25/49] 10.222.0.59 () {60 vars in 1193 bytes} [Wed May 18 14:48:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 14:48:45.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-c6fbcb67-ad15-442b-bf4a-8596f259eab8 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:45.604820 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-c6fbcb67-ad15-442b-bf4a-8596f259eab8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017392 May 18 14:48:45.605271 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 25/50] 10.222.0.59 () {60 vars in 1210 bytes} [Wed May 18 14:48:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:48:45.614444 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:45.628038 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017142 May 18 14:48:45.628613 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 26/51] 10.222.0.59 () {60 vars in 1210 bytes} [Wed May 18 14:48:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:48:45.638010 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-37424e63-c396-4fe5-bb59-64e1f01100de admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:45.643202 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.wsgi [None req-37424e63-c396-4fe5-bb59-64e1f01100de admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-37424e63-c396-4fe5-bb59-64e1f01100de admin admin] Request method failure captured: May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Accept: application/json May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Accept-Encoding: gzip, deflate May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Connection: keep-alive May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Content-Length: 0 May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Host: 10.222.0.59 May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Openstack-Api-Version: compute 2.90 May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Openstack-System-Scope: None May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: User-Agent: python-novaclient May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Auth-Token: gAAAAABihQdNK9YQ0sRHIBWwKjqNkGkL3Uc4lMjdipTxToWFR4FOuWbeKGIIy1VXV_c9tPbl2Mgr7WPnKuBFHf1pYG85GrS4qM2G69Y4l2aSxoq4d8f_zaaDgDWDPMLJRlxmWH5W6Zl8NVQlzUHV0Ewae5Hp0jxeCkP71ii0nj6TwMkp1t3AiqE May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Domain-Id: None May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Domain-Name: None May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Identity-Status: Confirmed May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Is-Admin-Project: True May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Openstack-Nova-Api-Version: 2.90 May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Domain-Id: default May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Domain-Name: Default May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Project-Name: admin May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Role: reader,member,admin May 18 14:48:45.644730 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Roles: reader,member,admin May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e866db7b1bd46b4b3abe110fcb71b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant: admin May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant-Id: 0e866db7b1bd46b4b3abe110fcb71b70 May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-Tenant-Name: admin May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User: admin May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Domain-Id: default May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Domain-Name: Default May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Id: 6bb17e1228d44efb843bda521c27b495 May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: X-User-Name: admin May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: method: > May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: exception: Flavor 451 could not be found. May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: action_args: {'id': '451'} May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:48:45.646314 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:45.647310 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: ERROR nova.api.openstack.wsgi May 18 14:48:45.648769 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-37424e63-c396-4fe5-bb59-64e1f01100de admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:48:45.650082 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-37424e63-c396-4fe5-bb59-64e1f01100de admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012023 May 18 14:48:45.650082 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 26/52] 10.222.0.59 () {60 vars in 1193 bytes} [Wed May 18 14:48:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 14:48:46.518806 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:46.519820 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 18 14:48:46.520212 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 27/53] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:46.711189 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-e3e0b097-d5bc-4dec-919f-23250faf442d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:46.729642 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-e3e0b097-d5bc-4dec-919f-23250faf442d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072173 May 18 14:48:46.730114 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 27/54] 10.222.0.59 () {64 vars in 1235 bytes} [Wed May 18 14:48:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:48:47.624479 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:47.625551 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 18 14:48:47.625948 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 28/55] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:47.814187 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-03eaf07b-7fcc-4a36-a5e8-a7a1a8672178 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:47.831378 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-03eaf07b-7fcc-4a36-a5e8-a7a1a8672178 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068454 May 18 14:48:47.831910 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 28/56] 10.222.0.59 () {64 vars in 1235 bytes} [Wed May 18 14:48:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:48:48.712279 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:48.713323 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 18 14:48:48.713752 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 29/57] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:48.900467 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-885d80f1-b2e5-4581-a7fe-c99862f49846 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:48.919454 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-885d80f1-b2e5-4581-a7fe-c99862f49846 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069529 May 18 14:48:48.919995 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 29/58] 10.222.0.59 () {64 vars in 1235 bytes} [Wed May 18 14:48:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:48:49.815336 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:49.816343 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 18 14:48:49.816769 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 30/59] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:50.006057 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-4dae4188-cbfa-40e3-bd0b-06682eb5040b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:48:50.023467 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-4dae4188-cbfa-40e3-bd0b-06682eb5040b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070031 May 18 14:48:50.024037 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 30/60] 10.222.0.59 () {64 vars in 1235 bytes} [Wed May 18 14:48:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:48:50.909697 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:50.910698 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 18 14:48:50.911097 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 31/61] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:48:51.101686 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-57411490-be55-4518-bc13-aa7f4145d1fc admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:48:51.121719 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-57411490-be55-4518-bc13-aa7f4145d1fc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072649 May 18 14:48:51.122198 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 31/62] 10.222.0.59 () {60 vars in 1202 bytes} [Wed May 18 14:48:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:49:52.943814 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:49:52.944863 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-3d4ea7e3-bc61-48ef-b538-5f542fd6eb78 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 18 14:49:52.945262 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 32/63] 10.222.0.59 () {54 vars in 930 bytes} [Wed May 18 14:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:49:52.953496 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:49:53.005686 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-65c7889e-5029-4dfe-a82a-48941280b3c2 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:49:53.025598 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-65c7889e-5029-4dfe-a82a-48941280b3c2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073553 May 18 14:49:53.026129 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 32/64] 10.222.0.59 () {60 vars in 1291 bytes} [Wed May 18 14:49:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:49:53.045136 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG dbcounter [-] [109419] Writing DB stats nova_api:SELECT=14 {{(pid=109419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:49:53.049337 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-a071d507-4fd1-4c40-ad29-4c328a077c4e admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:49:53.056966 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-a071d507-4fd1-4c40-ad29-4c328a077c4e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013330 May 18 14:49:53.057477 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 33/65] 10.222.0.59 () {60 vars in 1282 bytes} [Wed May 18 14:49:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:49:53.068481 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-a81b09c8-2bf8-4479-8f16-904871fc9874 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:49:53.076557 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-a81b09c8-2bf8-4479-8f16-904871fc9874 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011662 May 18 14:49:53.077105 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 33/66] 10.222.0.59 () {60 vars in 1285 bytes} [Wed May 18 14:49:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:49:53.088228 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:49:53.095498 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011280 May 18 14:49:53.096004 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 34/67] 10.222.0.59 () {60 vars in 1285 bytes} [Wed May 18 14:49:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:49:53.106674 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-c745ab4f-4d07-41c1-90c9-67ac1874bed8 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:49:53.114069 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-c745ab4f-4d07-41c1-90c9-67ac1874bed8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010746 May 18 14:49:53.114579 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 34/68] 10.222.0.59 () {60 vars in 1282 bytes} [Wed May 18 14:49:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:53:34.196287 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:34.197340 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 18 14:53:34.197730 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 35/69] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:53:34.351989 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_api:SELECT=6 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:53:34.467213 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-4879dbd9-b340-4f83-9243-c37895fe9d67 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:34.468375 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:53:34.468375 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: warnings.warn(msg) May 18 14:53:34.469602 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4879dbd9-b340-4f83-9243-c37895fe9d67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:34.470041 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4879dbd9-b340-4f83-9243-c37895fe9d67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:34.470811 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4879dbd9-b340-4f83-9243-c37895fe9d67 admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:34.471231 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-4879dbd9-b340-4f83-9243-c37895fe9d67 admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:34.504210 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-4879dbd9-b340-4f83-9243-c37895fe9d67 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153613 May 18 14:53:34.504790 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 35/70] 10.222.0.59 () {60 vars in 1193 bytes} [Wed May 18 14:53:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:53:35.402116 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:35.403129 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 18 14:53:35.403521 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 36/71] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:53:35.590768 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-9e08c5f5-a2f7-4fc8-92be-cefad42a5558 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:35.591933 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:53:35.591933 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: warnings.warn(msg) May 18 14:53:35.593141 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-9e08c5f5-a2f7-4fc8-92be-cefad42a5558 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:35.593575 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-9e08c5f5-a2f7-4fc8-92be-cefad42a5558 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:35.594342 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-9e08c5f5-a2f7-4fc8-92be-cefad42a5558 admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:35.594761 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-9e08c5f5-a2f7-4fc8-92be-cefad42a5558 admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:35.613608 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-9e08c5f5-a2f7-4fc8-92be-cefad42a5558 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073999 May 18 14:53:35.614085 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 36/72] 10.222.0.59 () {60 vars in 1193 bytes} [Wed May 18 14:53:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:53:46.903784 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:46.904825 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 18 14:53:46.905221 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 37/73] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:53:47.046550 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_cell0:SELECT=4 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:53:47.047753 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_cell1:SELECT=4 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:53:47.048877 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG dbcounter [-] [109418] Writing DB stats nova_api:SELECT=8 {{(pid=109418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:53:47.098111 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-65a45dfc-2b3f-4d91-9f3c-cc06d28aa16a admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:47.099270 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:53:47.099270 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: warnings.warn(msg) May 18 14:53:47.100479 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-65a45dfc-2b3f-4d91-9f3c-cc06d28aa16a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:47.100926 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-65a45dfc-2b3f-4d91-9f3c-cc06d28aa16a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:47.101691 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-65a45dfc-2b3f-4d91-9f3c-cc06d28aa16a admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:47.102111 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-65a45dfc-2b3f-4d91-9f3c-cc06d28aa16a admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:47.126926 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-65a45dfc-2b3f-4d91-9f3c-cc06d28aa16a admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085364 May 18 14:53:47.127410 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 37/74] 10.222.0.59 () {60 vars in 1193 bytes} [Wed May 18 14:53:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:53:48.027046 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: DEBUG nova.api.openstack.wsgi [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] Calling method '>' {{(pid=109419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:48.028101 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: INFO nova.api.openstack.requestlog [None req-b5504ddb-061f-41b8-87d9-5b9d958cc1cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 18 14:53:48.028487 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: [pid: 109419|app: 0|req: 38/75] 10.222.0.59 () {56 vars in 1074 bytes} [Wed May 18 14:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:53:48.218938 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG nova.api.openstack.wsgi [None req-5407610c-33da-4727-b2a2-4be38bc4f1a5 admin admin] Calling method '>' {{(pid=109418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:53:48.220098 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:53:48.220098 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: warnings.warn(msg) May 18 14:53:48.221285 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-5407610c-33da-4727-b2a2-4be38bc4f1a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:48.221720 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-5407610c-33da-4727-b2a2-4be38bc4f1a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:48.222510 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-5407610c-33da-4727-b2a2-4be38bc4f1a5 admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:53:48.222927 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: DEBUG oslo_concurrency.lockutils [None req-5407610c-33da-4727-b2a2-4be38bc4f1a5 admin admin] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:53:48.245129 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: INFO nova.api.openstack.requestlog [None req-5407610c-33da-4727-b2a2-4be38bc4f1a5 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078907 May 18 14:53:48.245605 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: [pid: 109418|app: 0|req: 38/76] 10.222.0.59 () {60 vars in 1193 bytes} [Wed May 18 14:53:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:54:47.694300 dv-cinder-839987-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 18 14:54:47.695170 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: Wed May 18 14:54:47 2022 - graceful shutdown triggered... May 18 14:54:47.695732 dv-cinder-839987-7-iscsi devstack@n-api.service[109418]: Gracefully killing worker 1 (pid: 109418)... May 18 14:54:47.696701 dv-cinder-839987-7-iscsi devstack@n-api.service[109419]: Gracefully killing worker 2 (pid: 109419)... May 18 14:54:48.696198 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: worker 1 buried after 1 seconds May 18 14:54:48.696751 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: worker 2 buried after 1 seconds May 18 14:54:48.696751 dv-cinder-839987-7-iscsi devstack@n-api.service[109417]: goodbye to uWSGI. May 18 14:54:48.697803 dv-cinder-839987-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 18 14:54:48.698366 dv-cinder-839987-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 18 14:54:48.701070 dv-cinder-839987-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 14:54:48.717465 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 14:54:48 2022] *** May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: nodename: dv-cinder-839987-7-iscsi May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: machine: x86_64 May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: clock source: unix May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: pcre jit disabled May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: detected number of CPU cores: 4 May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: current working directory: / May 18 14:54:48.731483 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: detected binary path: /usr/bin/uwsgi-core May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: your processes number limit is 47680 May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: your memory page size is 4096 bytes May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: detected max file descriptor number: 2048 May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: lock engine: pthread robust mutexes May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: thunder lock: enabled May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 14:54:48.732253 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 14:54:48.784075 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: Python main interpreter initialized at 0x55ab979ce9c0 May 18 14:54:48.784075 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: python threads support enabled May 18 14:54:48.784075 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: your server socket listen backlog is limited to 100 connections May 18 14:54:48.784075 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: your mercy for graceful operations on workers is 90 seconds May 18 14:54:48.784545 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: mapped 403077 bytes (393 KB) for 2 cores May 18 14:54:48.784545 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: *** Operational MODE: preforking *** May 18 14:54:48.784814 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: *** uWSGI is running in multiple interpreter mode *** May 18 14:54:48.784814 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: spawned uWSGI master process (pid: 123841) May 18 14:54:48.785022 dv-cinder-839987-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 14:54:48.785737 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: spawned uWSGI worker 1 (pid: 123864, cores: 1) May 18 14:54:48.785943 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: spawned uWSGI worker 2 (pid: 123865, cores: 1) May 18 14:54:48.786100 dv-cinder-839987-7-iscsi devstack@n-api.service[123841]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 14:54:49.997220 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 14:54:50.014621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 14:54:50.795972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:54:50.795972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: from cryptography.utils import int_from_bytes May 18 14:54:50.796240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:54:50.796240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: from cryptography.utils import int_from_bytes May 18 14:54:50.810461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:54:50.810461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: from cryptography.utils import int_from_bytes May 18 14:54:50.810861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:54:50.810861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: from cryptography.utils import int_from_bytes May 18 14:54:53.254097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 14:54:53.254097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 14:54:53.254713 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 14:54:53.254799 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 14:54:53.255060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 14:54:53.255380 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.255702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.256024 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.256339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.256692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.257002 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.257315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.257629 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.257954 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.258733 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.259064 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.259351 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-7-iscsi {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.259661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.259966 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.260272 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.260610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.260908 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.261227 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.261528 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.262026 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.263379 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.263379 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.263379 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.263665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.263995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.264300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.264642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.264964 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.265284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.265590 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.265986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-7-iscsi {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.266306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.266618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.266926 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.267363 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.267648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.267955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.268268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.268621 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.268922 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.269237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.269554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.269870 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.270200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.270482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.270783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.271100 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.271405 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.271708 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.272005 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.272256 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.272560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.272918 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.273234 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.273551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.274359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.274614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.274929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.275244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.275547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.275851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.276153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.276455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.276782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.277085 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.277392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.277688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.278001 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.278310 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.278626 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.278927 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.279241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.279634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.279882 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.280183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.280519 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.280873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.281183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.281500 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.282366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.282366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.282952 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.282952 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.283264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.283425 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.283575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.283824 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.284122 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.284426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.284770 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.285075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.285378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.285679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.286021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.286279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.286580 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.286885 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.287188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.287487 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.287788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.288089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.288389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.288721 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.289041 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.289383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.290071 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.290696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.291301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.291778 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.292105 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.292222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 14:54:53.292630 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.292728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 14:54:53.292812 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.293012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 14:54:53.293143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.293347 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.293651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.293748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 14:54:53.293920 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 14:54:53.294018 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.294259 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.294357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.294568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.294666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.294881 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.294990 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.295180 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.295835 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.295933 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296101 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296327 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296400 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.296962 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.297139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.297254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.297411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.297546 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.297735 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.297851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.298077 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-7-iscsi {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.298189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.298398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.298503 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.298707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.298814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.299275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.299374 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.299579 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.299693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.299883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.299999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.300180 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.300274 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.300492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.300610 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.300871 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.301032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.301200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.301353 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.301708 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.301815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.301901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.301999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.302203 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.302310 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.302480 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.302574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.302794 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.302896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.303102 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.303206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.303412 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.303505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.303735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.303836 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.304043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.304156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.304349 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.304492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-7-iscsi {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.304710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.304867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.305022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.305195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.305338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.305515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.305664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.305934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.306027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.306252 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.306353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.306565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.306666 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.306947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.307059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.307184 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.307288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.307495 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.307595 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.307813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.307912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.308139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.308311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.308482 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.308607 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.308815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.308921 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.309124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.309232 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.309437 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.309529 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.309749 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.309849 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.310058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.310168 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.310365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.310465 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.310673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.310772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.310923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.311016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.311234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.311328 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.311561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.311668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.311984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.312084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.312194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.312310 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.312480 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.312663 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.312771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.312860 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.313037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.313131 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.313360 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.313463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.313673 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.313773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.314002 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.314116 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.314293 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.314404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.314602 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.314696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.314910 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.315016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.315220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.315322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.315522 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.315622 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.315827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.315926 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.316128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.316217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.316428 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.316521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.316768 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.316852 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.317089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.317192 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.317381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.317493 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.317685 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.317776 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.318011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.318108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.318321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.318422 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.318648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.318748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.318951 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.319034 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.319258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.319339 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.319566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.319658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.319872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.319954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.320176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.320270 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.321766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.322171 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.322171 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.322485 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.322879 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.323034 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.323185 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.323351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.323503 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.323654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.323654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.323949 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.324107 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.324269 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.324421 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.324571 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.324758 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.324911 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.325074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.325226 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.325384 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.325543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.325704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.325866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.326024 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.326175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.326335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.326486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.326644 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.326814 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.326974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.327158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.327391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.327555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.327707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.327869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.328026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.328206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.328383 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.328720 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.328884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.329046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.329217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.329378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.329536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.329687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.329845 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.329997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.330147 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.330408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.330567 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.330718 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.330874 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.331027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.331186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.331348 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.331500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.331664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.331815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.331965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.332357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.332523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.332701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.332990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.333261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.333441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.333596 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.333747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.333908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.334068 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.334228 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.334386 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.334537 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.334689 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.334689 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.334987 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.335139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.335290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.335290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.335582 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.335753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.335905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.336057 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.336795 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.336955 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.337117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.337373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.337609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.337766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.337917 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.338075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.338245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.338408 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.338599 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.338901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.339061 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.339213 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.339374 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.339540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.339693 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.339850 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.340008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.340159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.340309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.340557 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.340747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.340915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.341075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.341226 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.341390 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.341550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:54:53.341702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.341858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.342017 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.342175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.342574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.342731 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.342882 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.343137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.343308 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.343471 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.343636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.343794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.343947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344263 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344423 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.344903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.345210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.345372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.345524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.345684 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.345834 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.345993 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.346144 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.346303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.346455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.346703 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.346863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.347015 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.347165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.347336 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.347494 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.347731 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.347891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.348050 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.348218 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.348380 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.348532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.348734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349025 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349356 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349671 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.349980 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.350189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.350364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.350541 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.350769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.350934 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.351093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.351244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.351405 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.351558 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.351758 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.351931 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.352092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.352250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.352603 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.352905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.352905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.353326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.353523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.353689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.353848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354789 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.354947 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.355100 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.355256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.355408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.355572 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.355725 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.355875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.356032 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.356184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.356345 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.356509 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.356718 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.356873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.357022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.357173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.357332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.358172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.358339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.358506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.358658 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.358821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.359134 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.359308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.359475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.359636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.359798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.359956 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.360116 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.360268 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.360430 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.360600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.360790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.361031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.361200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.361361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.361682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.361841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.361992 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.362142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.362292 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.362444 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.362745 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.362941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.363209 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.363505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.363673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.363836 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.363999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.363999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.364295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.364447 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.364617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.364787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.364940 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.365091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.365240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.365401 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.365561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.365729 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.365899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366680 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366680 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.366982 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.367134 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.367285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.367481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.367648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.367820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.367974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.368150 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.368386 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.368552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.368795 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.368795 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.369110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.369417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.369577 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.369816 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.369972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.370130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.370302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.370454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.370834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.371032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.371264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.371439 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.371600 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.371783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.372092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.372266 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.372420 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.372571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.372806 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.372901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373002 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373076 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373167 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373767 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373870 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.373960 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374146 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374232 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374491 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374587 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374853 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.374933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375018 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375113 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375199 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375382 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375468 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375818 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.375984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376168 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376510 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.376935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377101 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377192 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377278 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377808 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.377984 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378534 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378708 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378793 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378884 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.378968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379140 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379353 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379531 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379621 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379786 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379870 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.379960 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380393 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380483 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.380947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381112 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381837 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.381939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382036 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382818 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.382905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.383486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.383589 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.383870 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.383967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384062 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384155 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.384884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385037 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385215 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385298 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385679 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.385946 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386129 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386129 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386379 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.386960 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387050 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387248 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387356 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387649 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387847 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.387941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.388145 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.388239 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.388461 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.388549 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.388791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.388885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.389091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.389193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.389392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.389491 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.389690 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.389784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390329 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390421 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.390969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391062 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391374 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391589 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391767 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391892 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.391988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.392198 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.392289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.392539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.392878 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.393199 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.393348 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.393524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.393661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.393861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.393971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.394172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.394266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.394485 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.394569 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.394804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.394896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.395132 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.395225 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.395448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.395530 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.395752 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.395848 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.396216 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.396504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.396850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.397172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.397396 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.397502 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.397695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.397788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.398034 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.398136 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.398352 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.398455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.398710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.399314 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.399518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.399612 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.399825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.399927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.400135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.400229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.400445 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.400551 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.400855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.401191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.401671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.401805 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.401996 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.402119 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.402328 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.402464 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.402638 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.402740 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.402944 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.403065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.403255 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.403349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.403585 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.403686 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.403899 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.404002 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.404205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.404344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.404515 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.404683 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.404848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405010 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405325 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405466 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405639 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405899 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.405991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.406213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.406316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.406523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.406618 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.406827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.406920 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.407138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.407231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.407450 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.407544 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.407763 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.407862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.408073 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.408178 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.408376 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.408468 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.408717 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.408840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.409982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.410088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.410284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.410385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.410590 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.410682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.410898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411019 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411202 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411313 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411500 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411594 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411804 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.411897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.412125 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.412225 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.412429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.412527 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.412773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.412869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.413154 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.413241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.413466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.413567 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.413770 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.413863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.414095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.414198 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.414507 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.414620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.414817 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415035 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415562 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415770 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.415870 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.416072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.416165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.416383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.416498 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.416712 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.416820 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417340 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417644 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417736 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.417951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418355 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418878 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.418973 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.419187 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.419290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.419503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.419595 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.419819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.419924 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.420127 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.420230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.420443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.420543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.420775 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.420869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.421097 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.421192 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.421412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.421514 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.421717 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.421818 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422023 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422117 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422323 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422423 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422622 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422724 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.422935 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.423034 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.423232 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.423331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.423536 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.423642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.423840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.424194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.424410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.424541 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.424732 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.424841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425652 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.425968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.426061 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.426275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.426364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.426590 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.426683 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.426903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427001 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427202 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427508 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427600 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427809 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.427911 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.428108 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.428209 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.428406 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.428500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.428735 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.428830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.429048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.429208 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.429357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.429458 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.429670 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.429792 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430126 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430324 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430424 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430632 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.430937 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431038 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431569 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431676 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431884 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.431987 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.432205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.432306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.432504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.432627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.432835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.432923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.433123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.433217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.433421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.433532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.433720 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.433822 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.434927 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435018 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435227 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435542 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435644 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.435942 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.436158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.436251 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.436464 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.436552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.436788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.436882 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.437090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.437183 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.437389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.437481 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.437725 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.437826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438026 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438126 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438354 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438447 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.438987 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.439079 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.439301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.439402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.439604 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.439709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.439915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440223 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440329 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440532 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440703 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.440962 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.441181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.441282 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.441489 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.441598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.441799 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.441892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.442112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.442204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.442416 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.442514 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.442730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.442822 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443041 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443346 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443887 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.443988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.444212 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.444314 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.444522 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.444697 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.444865 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.445031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.445175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.445347 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.445972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.446176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.446309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.446488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.446597 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.446805 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.446902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.447121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.447224 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.447443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.447547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.447760 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.447854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.448068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.448163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.448390 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.448492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.448749 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.448846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449064 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449377 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449475 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.449999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.450092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.450317 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.450447 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.450646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.450768 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.450950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451070 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451237 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451575 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451678 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451862 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.451981 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.452168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.452262 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.452473 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.452567 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.452811 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.452934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.453120 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.453290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.453433 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.453587 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.453716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.453943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.454089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.454262 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.454413 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.454579 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.454737 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.454910 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455542 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455644 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.455958 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.456161 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.456255 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.456472 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.456703 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.456827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457015 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457666 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.457985 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.458106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.458299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.458435 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.458611 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.458762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.458935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.459081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.459237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.459408 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.459538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.459828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.459929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.460136 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.460229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.460437 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.460530 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.460780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.460877 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.461103 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.461231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.461943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.462066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.462254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.462404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.462571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.462675 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.462881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.463107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.463202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.463455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.463557 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.463770 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.463949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.464092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.464189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.464401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.464501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.464737 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.464832 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465044 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465359 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465462 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465829 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.465971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.466064 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.466283 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.466385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.466592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.466692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.466894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467040 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467503 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467809 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.467903 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.468108 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.468210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.468414 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.468507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.468741 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.468836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.469049 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.469158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.469356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.469464 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.469701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.469857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.470023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.470177 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.470360 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.470525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.470698 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.470864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.471035 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.471189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.471440 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.471602 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.471755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.471911 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.472081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.472240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.472402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.472551 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.472788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.472958 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.473124 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.473270 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.473495 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.473660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.473821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474038 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474346 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474500 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474661 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474815 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.474975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.475140 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.475305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.475507 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.475703 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.475854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.476019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.476180 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.476342 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.476494 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.476663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.476847 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.477023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.477242 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.477400 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.477543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.477707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.477873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478313 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478465 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478777 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.478914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479327 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479890 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.479973 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480060 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480152 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480405 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480496 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480628 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480848 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.480947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.481160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.481260 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.481467 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.481569 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.481775 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.481884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.482081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.482174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.482389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.482473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.482695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.482779 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483000 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483083 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483613 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.483916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.484178 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.484263 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.484516 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.484624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.484866 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.484950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.485190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.485287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.485501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.485592 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.485820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.485916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.486126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.486211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.486583 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.486689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.486786 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.486873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.487027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.487130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.487357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.487535 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.487690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.487866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.488018 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.488178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.488351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.488478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.488885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.488994 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.489230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.489488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.489591 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.489851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.490098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.490192 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.490466 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.490690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.490774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.491081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.491276 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.491462 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.491599 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.491780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.491909 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.492099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.492237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.492453 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.492640 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.492813 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.492968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.493138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.493291 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.493460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.493595 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.493779 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.494087 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.494189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.494396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.494500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.494706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.494799 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495120 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495415 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.495929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.496072 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.496322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.496461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.496619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.496727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.496942 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.497262 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.497369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.497671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.497837 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.497981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.498293 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.498598 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.498702 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.498905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.499211 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.499310 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.499516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.499818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.499912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.500121 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.500429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.500520 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.500757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.500946 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.501257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.501351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.501560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.501654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.501862 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.501966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.502163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.502267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.502495 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.502595 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.502827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.502933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.503145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.503245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.503459 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.503664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.503791 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.503975 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.504111 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.504370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.504522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.504634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.504763 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.504930 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.505080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.505250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.505564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.505665 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.505871 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.505981 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.506202 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.506315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.506509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.506619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.506822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.506915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.507132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.507273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.507440 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.507576 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.507748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.507869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.508607 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.508711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.508941 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509571 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509672 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.509999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.510203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.510350 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.510522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.510624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.510834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.510927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.511142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.511357 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.511479 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.511620 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.511756 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.511936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.512088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.512248 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.512399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.512566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.512845 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.512950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.513046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.513206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.513343 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.513522 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.513654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.513862 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514025 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514271 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514495 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514590 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514806 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.514899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.515132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.515234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.515454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.515566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.515769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.515864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.516084 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.516203 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.516445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.516570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.516830 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.516921 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.517068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.517174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.517385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.517486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.517695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.517799 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.518002 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 14:54:53.518111 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.518320 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.518634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.518961 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.519279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.519595 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.519950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.520272 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.520836 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.521180 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.521507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.521849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.522189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.522503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.522819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.523125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.523455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.524289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.524721 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.524949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.525267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.525585 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.525908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.526224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.526544 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.526862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.527177 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.527492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.527807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.528127 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.528472 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.528821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.529144 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.529466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.529787 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.530102 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.530421 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.530734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.531046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.531368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.531703 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.532020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.532330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.532794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.533116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.533440 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.533770 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.534086 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.534413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.534740 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.535055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.535380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.535701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.536037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.536382 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.536741 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.537072 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.537380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.537690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.538000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.538316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.538640 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.538954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.539289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.539600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.539915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.540223 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.540536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.540868 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.541177 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.541491 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.541798 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.542105 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.542411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.542720 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.543027 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.543334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.543646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.543954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.544260 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.544566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.544896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.545203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.545538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.545882 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.546201 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.546531 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.546846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.547174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.547486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.547814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.548139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.548457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.548800 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.549390 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.549707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.550025 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.550341 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.550656 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.550970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.551283 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.551613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.551943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.552254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.552598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.552926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.553251 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.553570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.553886 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.554219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.554533 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.555364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.555695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.556011 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.556334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.556751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.557078 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.557416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.557746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.558065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.558398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.558730 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.559088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.559404 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.559755 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.560088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.560408 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.560758 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.561075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:54:53.561325 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 14:54:53.580387 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO dbcounter [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Registered counter for database nova_api May 18 14:54:53.600344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_db.sqlalchemy.engines [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.607756 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writer thread running {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.622144 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO dbcounter [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Registered counter for database nova_api May 18 14:54:53.642660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_db.sqlalchemy.engines [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.650092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writer thread running {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.664317 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.context [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aee4120-6738-4344-ac0e-c12b2bd21945(cell1) {{(pid=123865) load_cells /opt/stack/nova/nova/context.py:464}} May 18 14:54:53.668771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:54:53.670330 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:54:53.671113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:54:53.673061 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:54:53.675246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO dbcounter [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Registered counter for database nova_cell0 May 18 14:54:53.679177 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO dbcounter [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Registered counter for database nova_cell1 May 18 14:54:53.686803 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_db.sqlalchemy.engines [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.689905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_db.sqlalchemy.engines [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.692297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writer thread running {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.707362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.context [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aee4120-6738-4344-ac0e-c12b2bd21945(cell1) {{(pid=123864) load_cells /opt/stack/nova/nova/context.py:464}} May 18 14:54:53.711865 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:54:53.713469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:54:53.714329 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:54:53.716229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:54:53.718290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO dbcounter [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Registered counter for database nova_cell0 May 18 14:54:53.722279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO dbcounter [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Registered counter for database nova_cell1 May 18 14:54:53.729375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_db.sqlalchemy.engines [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.731043 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_db.sqlalchemy.engines [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.736491 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writer thread running {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.741692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writer thread running {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.833855 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writer thread running {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.844069 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO dbcounter [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Registered counter for database nova_cell0 May 18 14:54:53.851984 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_db.sqlalchemy.engines [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.856529 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writer thread running {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:53.890976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO dbcounter [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Registered counter for database nova_cell0 May 18 14:54:53.897957 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_db.sqlalchemy.engines [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:54:53.902470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writer thread running {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:54:54.176483 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: WARNING keystonemiddleware.auth_token [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:54:54.185989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: WARNING keystonemiddleware.auth_token [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:54:54.226316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: WARNING keystonemiddleware.auth_token [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:54:54.234838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: WARNING keystonemiddleware.auth_token [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:54:54.531083 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: WARNING keystonemiddleware.auth_token [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:54:54.539124 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: WARNING keystonemiddleware.auth_token [None req-6d77982c-0549-4d9d-b11b-2cd9aa3b96bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:54:54.545084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab979ce9c0 pid: 123865 (default app) May 18 14:54:54.584291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: WARNING keystonemiddleware.auth_token [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 14:54:54.591200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: WARNING keystonemiddleware.auth_token [None req-fedcf6a7-afa2-437c-9eb2-9b97a9dc0276 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 14:54:54.597288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab979ce9c0 pid: 123864 (default app) May 18 14:55:35.851588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.852415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.853470 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.854178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.308445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.309319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.310293 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.311355 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:37.292285 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-70e22ece-c019-44b3-a7f7-63823ecc550a tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Action: 'create', calling method: .version_select at 0x7fa8a2a0e4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1250219618", "metadata": {"Type": "work"}}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:37.633346 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b5d8deb0-8348-4b30-875a-e1b5c954f20c tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Action: 'create', calling method: .version_select at 0x7fa8a2a0d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1439638016"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:40.028240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-70e22ece-c019-44b3-a7f7-63823ecc550a tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.181895 May 18 14:55:40.029917 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Wed May 18 14:55:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4186 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 18 14:55:40.353582 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-474474961", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "networks": [{"uuid": "12e453f0-838c-4ad6-bf42-6764e1f9cc1f"}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:40.619653 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] validate_networks() for [('12e453f0-838c-4ad6-bf42-6764e1f9cc1f', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:55:41.030188 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b5d8deb0-8348-4b30-875a-e1b5c954f20c tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.731455 May 18 14:55:41.031723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 1/2] 10.222.0.59 () {60 vars in 1154 bytes} [Wed May 18 14:55:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4735 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 18 14:55:41.037528 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1c5cb2ed-a921-4951-ad3f-45ce808f021e tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a28d6550>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:41.307053 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1c5cb2ed-a921-4951-ad3f-45ce808f021e tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 354 microversion: 2.1 time: 0.273919 May 18 14:55:41.314278 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:41 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:41.321071 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-eb4ffa74-6e45-4bf7-8a32-9ca87d08c637 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a28d6670>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:41.401144 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-eb4ffa74-6e45-4bf7-8a32-9ca87d08c637 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18" status: 200 len: 346 microversion: 2.1 time: 0.085287 May 18 14:55:41.401706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:41 2022] GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:41.412007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6c96703c-7eb1-4b77-8c58-ac8f2894e31c tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a28d6d30>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:41.502825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6c96703c-7eb1-4b77-8c58-ac8f2894e31c tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 354 microversion: 2.1 time: 0.099918 May 18 14:55:41.503600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 4/5] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:41 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:41.511621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8810edb4-0a10-4020-bfcc-2b993db75bb8 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Action: 'create', calling method: .version_select at 0x7fa8a28e83a0>, body: {"snapshot": {"volume_id": "0d6550e3-81c1-41c3-9fa2-4d478b6a4c18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2014108978"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:41.940007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8810edb4-0a10-4020-bfcc-2b993db75bb8 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.435151 May 18 14:55:41.940734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 5/6] 10.222.0.59 () {60 vars in 1161 bytes} [Wed May 18 14:55:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:41.946595 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ad14afc8-77ac-4c86-af3d-5eabe7519b18 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a28d6d30>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:42.118993 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ad14afc8-77ac-4c86-af3d-5eabe7519b18 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 202 len: 0 microversion: 2.1 time: 0.176922 May 18 14:55:42.122856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 6/7] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 14:55:41 2022] DELETE /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:55:42.125361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b8c02396-eb64-4733-80b6-06f3c4cc207c tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a28d6670>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:42.192200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b8c02396-eb64-4733-80b6-06f3c4cc207c tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 287 microversion: 2.1 time: 0.071108 May 18 14:55:42.194645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 7/8] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:42 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:42.201180 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-85ad1f31-dbfd-4a51-a315-3f663eb3339a tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a28e88b0>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:42.338803 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-85ad1f31-dbfd-4a51-a315-3f663eb3339a tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 353 microversion: 2.1 time: 0.141267 May 18 14:55:42.339457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 8/9] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:42 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:42.343892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a57e4264-6b10-47c8-88b4-cb32de16ca73 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a28d6820>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:42.547607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a57e4264-6b10-47c8-88b4-cb32de16ca73 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.206878 May 18 14:55:42.549005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 9/10] 10.222.0.59 () {58 vars in 1139 bytes} [Wed May 18 14:55:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:42.564439 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-de63fa1b-f32e-47f3-b64b-17fccf5c11dd tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a28e8670>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:42.672542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-de63fa1b-f32e-47f3-b64b-17fccf5c11dd tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 287 microversion: 2.1 time: 0.116550 May 18 14:55:42.673559 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 10/11] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:42 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:42.959714 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:55:42.960281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:55:42.960775 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:55:42.961261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:55:42.961740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:55:42.994539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:42.994989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:42.995773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:43.006080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:43.088965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Getting quotas for project 8861f7058f96459fa715dddf23cc3908. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:55:43.115805 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Getting quotas for user 4e4769e15ff54700be019d0b0dee5f64 and project 8861f7058f96459fa715dddf23cc3908. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:55:43.130747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:55:43.136223 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:55:43.267662 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ba486d7a-91de-4743-b202-2a496a91f4e9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.226613 May 18 14:55:43.269152 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 2/12] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:55:43.281442 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-202b5b1b-8565-4759-921d-ea90d5c2e3db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:43.282243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-202b5b1b-8565-4759-921d-ea90d5c2e3db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:43.353369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a0f59243-a3f2-422b-b038-f48871bb93aa tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a177e040>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:43.475602 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-202b5b1b-8565-4759-921d-ea90d5c2e3db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:43.504110 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-202b5b1b-8565-4759-921d-ea90d5c2e3db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1214 microversion: 2.1 time: 0.228312 May 18 14:55:43.508260 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a0f59243-a3f2-422b-b038-f48871bb93aa tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 353 microversion: 2.1 time: 0.160599 May 18 14:55:43.509657 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 3/13] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:43 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:55:43.523004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 11/14] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:43 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:43.686888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d13d313c-17a6-4f7d-af28-fe1173911312 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a27e9b80>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:43.737280 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d13d313c-17a6-4f7d-af28-fe1173911312 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 287 microversion: 2.1 time: 0.055503 May 18 14:55:43.742287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 4/15] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:43 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:44.521462 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8c6e2518-71f4-4a21-a5da-625ca036b02f tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a177e0d0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:44.624172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8c6e2518-71f4-4a21-a5da-625ca036b02f tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 353 microversion: 2.1 time: 0.106411 May 18 14:55:44.624772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 5/16] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:44 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:55:44.629626 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f9ea654c-a15a-4c80-9178-341eab90a339 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:44.630508 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f9ea654c-a15a-4c80-9178-341eab90a339 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:44.798921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c0631010-a5d2-49ed-bc21-901914b7f892 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'create', calling method: .version_select at 0x7fa8a28d6670>, body: {"keypair": {"name": "tempest-keypair-1433289601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0GNzf/xNv7OxeqpmW1nZIac3zBjX/Z+HFUOXwCY6H3JCNGDUmOcoJKX6SEkkOx+H+PvOB8VVWj3VNglUq2SYr0n5UNm41NWySMNY5jrq4Y+oert/MkRZT1e6B/APkNjw=="}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:44.926230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-c0631010-a5d2-49ed-bc21-901914b7f892 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:55:44.936954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-c0631010-a5d2-49ed-bc21-901914b7f892 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for user 25784e3193b047ecaa6788bd79611f3f and project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:55:44.949595 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f9ea654c-a15a-4c80-9178-341eab90a339 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:44.974724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f9ea654c-a15a-4c80-9178-341eab90a339 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1214 microversion: 2.1 time: 0.348740 May 18 14:55:44.978996 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 6/17] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:44 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1214 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:44.992924 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-eab37a5f-3e36-4048-9bcb-b5509995bf05 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a178d430>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:45.029198 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c0631010-a5d2-49ed-bc21-901914b7f892 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.516982 May 18 14:55:45.031811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 12/18] 10.222.0.59 () {62 vars in 1199 bytes} [Wed May 18 14:55:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 521 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 18 14:55:45.057006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-eab37a5f-3e36-4048-9bcb-b5509995bf05 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 287 microversion: 2.1 time: 0.076889 May 18 14:55:45.059160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 7/19] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:44 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:45.643917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c0dd9132-b1a4-465b-97cb-33c64bb35d9d tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a2832670>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:45.749353 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c0dd9132-b1a4-465b-97cb-33c64bb35d9d tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 353 microversion: 2.1 time: 0.116086 May 18 14:55:45.750093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 13/20] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:45 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:45.997352 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:45.998042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:46.009452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:46.010156 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:46.011628 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:46.012382 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:46.072035 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-07b1e85d-11ac-4395-8633-f0b1c702fcc0 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a2805c10>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:46.154213 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-07b1e85d-11ac-4395-8633-f0b1c702fcc0 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 288 microversion: 2.1 time: 0.087830 May 18 14:55:46.155159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 14/21] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:46 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:46.165426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-dd899ee1-510f-4272-a5fe-3b3ccdbecb8c tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a2832160>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:46.327888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-dd899ee1-510f-4272-a5fe-3b3ccdbecb8c tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 202 len: 0 microversion: 2.1 time: 0.166792 May 18 14:55:46.329152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 15/22] 10.222.0.59 () {58 vars in 1253 bytes} [Wed May 18 14:55:46 2022] DELETE /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 14:55:46.338598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9707caa0-e876-4b2e-b05c-f1e3e149f4f5 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a1fcf160>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:46.360464 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:46.384823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d1ac0a19-7ac1-4965-a68c-bc34c550ab93 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1218 microversion: 2.1 time: 0.388653 May 18 14:55:46.387337 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 8/23] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:45 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1218 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:46.435889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9707caa0-e876-4b2e-b05c-f1e3e149f4f5 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 287 microversion: 2.1 time: 0.101534 May 18 14:55:46.436848 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 16/24] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:46 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:46.764740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0fbcc33c-8c2a-495d-a361-77f3fc6dec2b tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a1716ca0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:46.866704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0fbcc33c-8c2a-495d-a361-77f3fc6dec2b tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 353 microversion: 2.1 time: 0.108171 May 18 14:55:46.867736 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 9/25] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:46 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:47.405718 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:47.406918 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:47.418820 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:47.420190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:47.422950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:47.426885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:47.449208 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-028f488e-2681-4eb6-9242-3e86d5a57d94 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a17245e0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:47.509115 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-028f488e-2681-4eb6-9242-3e86d5a57d94 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 200 len: 287 microversion: 2.1 time: 0.065546 May 18 14:55:47.511544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 10/26] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:47 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:47.703909 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:47.723120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4b1d6f7f-4664-4cad-9acd-389b81844894 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1218 microversion: 2.1 time: 0.323938 May 18 14:55:47.735592 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 17/27] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:47 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1218 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:47.885065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9769150f-5cc1-415a-b178-1897733dec95 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a1f3bd30>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:48.002482 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9769150f-5cc1-415a-b178-1897733dec95 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 200 len: 353 microversion: 2.1 time: 0.123212 May 18 14:55:48.003057 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 18/28] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:47 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:48.038805 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-162197031", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:48.150499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] validate_networks() for [('22bd5425-6379-4740-b6c4-d6f9b7aaeddb', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:55:48.483357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-268945970", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0410fe00-b11d-4309-b353-5cb8e97484be"}], "security_groups": [{"name": "tempest-securitygroup--169624407"}], "key_name": "tempest-keypair-1433289601", "user_data": "}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:49.079367 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] validate_networks() for [('0410fe00-b11d-4309-b353-5cb8e97484be', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:55:49.507298 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:55:49.507740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:55:49.508177 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:55:49.508616 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:55:49.509011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:55:49.533080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:49.533533 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:49.534327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:49.534757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:49.609227 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for project 84835592358a4e188df86896d6015647. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:55:49.618935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for user 2aa34e012c824754833a12ac66413aaf and project 84835592358a4e188df86896d6015647. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:55:49.659243 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:55:49.670706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:55:49.866759 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-512a2d5d-e429-4518-8685-24542e682f0a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.105222 May 18 14:55:49.868043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 11/29] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:55:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:55:49.878338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-501facc4-479e-4632-9fc2-d57553bd705a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a1716940>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:49.969437 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-501facc4-479e-4632-9fc2-d57553bd705a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] HTTP exception thrown: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-501facc4-479e-4632-9fc2-d57553bd705a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Request method failure captured: May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d HTTP/1.1 May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjoD81PkAvZ192DpuVClrRkHNSUGeb_lGAvcXxrMtprQzLWMpQr7WFMeXv2WtgXOm89ZD4mNEoWCSAocdv38wMb4OZgFduhxjbdTeqZGnDjPsTlBE3YYjVcAMKFJUub7W_5nfz2DL41JYkRFXI2dSKuQPNgcCNyWcCJBCqkHHEKGhA May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:49.976059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 25967732542c4a28a38b1b8a121037f1 May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '700e9d76-bf13-4822-b342-9477d6861c5d'} May 18 14:55:49.977297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. (HTTP 404) (Request-ID: req-12249a1f-c3b5-413d-8763-e941a38dc6b3) May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.978033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:49.979130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 18 14:55:49.980361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:49.981570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-501facc4-479e-4632-9fc2-d57553bd705a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Returning 404 to user: Snapshot 700e9d76-bf13-4822-b342-9477d6861c5d could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:49.984133 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-501facc4-479e-4632-9fc2-d57553bd705a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d" status: 404 len: 111 microversion: 2.1 time: 0.111956 May 18 14:55:49.990186 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 12/30] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 14:55:49 2022] GET /compute/v2.1/os-snapshots/700e9d76-bf13-4822-b342-9477d6861c5d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:55:50.002461 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:50.003482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:50.018191 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:50.021848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:50.023687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:50.026044 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:50.291674 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:50.301157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3e3c8c57-3e33-4ab9-9ae3-4800450eef1e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1272 microversion: 2.1 time: 0.309695 May 18 14:55:50.301743 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 13/31] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:49 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:50.324902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ff4b0363-2b86-43ce-8c7a-4bf59bd7ac80 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Calling method '.version_select at 0x7fa8a164a940>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:50.543758 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-ff4b0363-2b86-43ce-8c7a-4bf59bd7ac80 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] HTTP exception thrown: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. May 18 14:55:50.545538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:55:50.545945 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:55:50.546433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ff4b0363-2b86-43ce-8c7a-4bf59bd7ac80 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Request method failure captured: May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 HTTP/1.1 May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjnmp8on17ZTBTW5XWPI5uegGLfjmga9rywB1EZnlKEWVECH3Bi-1NLXi10aZO84FwrGceLgpiKTZWf5CJuZ13Pt25jNide_0SChYxfCI2Y-7srlIPLjyILb7sAdZC9uOUGLkx_YtP2vb6tBf7eBcXCeRomNQqcDfzKz3XSVGhBu5I May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: b4890d7d8a4c4f129840f48d5fb6b405 May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesGetTestJSON-1486316873 May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:50.549426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4890d7d8a4c4f129840f48d5fb6b405"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4890d7d8a4c4f129840f48d5fb6b405"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4890d7d8a4c4f129840f48d5fb6b405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4890d7d8a4c4f129840f48d5fb6b405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesGetTestJSON-1486316873 May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: b4890d7d8a4c4f129840f48d5fb6b405 May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesGetTestJSON-1486316873 May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesGetTestJSON-1486316873-project May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 476a193861874fcbb7bff6038bb02ee4 May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesGetTestJSON-1486316873-project May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '52381b1c-61a2-4aa9-80e7-44481433bcb9'} May 18 14:55:50.551039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. (HTTP 404) (Request-ID: req-4dd24bf6-181f-4e57-87e0-fe3a2ed40d1b) May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:50.551867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:50.552990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 14:55:50.554677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. May 18 14:55:50.555764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:50.556406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:55:50.556406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:55:50.556547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ff4b0363-2b86-43ce-8c7a-4bf59bd7ac80 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] Returning 404 to user: Volume 52381b1c-61a2-4aa9-80e7-44481433bcb9 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:50.569673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ff4b0363-2b86-43ce-8c7a-4bf59bd7ac80 tempest-VolumesGetTestJSON-1486316873 tempest-VolumesGetTestJSON-1486316873-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9" status: 404 len: 109 microversion: 2.1 time: 0.264339 May 18 14:55:50.572232 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 14/32] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:50 2022] GET /compute/v2.1/os-volumes/52381b1c-61a2-4aa9-80e7-44481433bcb9 => generated 109 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:55:50.606667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0ae48fd4-29d3-40d0-8501-0c911b7cb603 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:50.609242 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0ae48fd4-29d3-40d0-8501-0c911b7cb603 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:50.619880 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:50.623747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:50.628081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:50.631470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:50.753980 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:55:50.764769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for user 25784e3193b047ecaa6788bd79611f3f and project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:55:50.814705 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:55:50.826070 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:55:50.860163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0ae48fd4-29d3-40d0-8501-0c911b7cb603 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:50.871039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0ae48fd4-29d3-40d0-8501-0c911b7cb603 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1221 microversion: 2.1 time: 0.295937 May 18 14:55:50.886209 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 15/33] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:50 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1221 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:50.896663 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-954f074b-d3d2-4731-adbd-cca4218a233a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a164aca0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:50.993682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-887eab50-fdb5-4618-8f4e-0abb96186064 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.515564 May 18 14:55:51.002783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 19/34] 10.222.0.59 () {62 vars in 1187 bytes} [Wed May 18 14:55:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 14:55:51.018675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-25b9b205-57c5-4094-8eaa-ac2723242840 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:51.035104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-25b9b205-57c5-4094-8eaa-ac2723242840 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:51.122914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-954f074b-d3d2-4731-adbd-cca4218a233a tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18" status: 202 len: 0 microversion: 2.1 time: 0.235312 May 18 14:55:51.124184 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 16/35] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 14:55:50 2022] DELETE /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:55:51.133143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-024f4db6-8f85-4f0d-946c-ddbc92e907c4 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a16b7790>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:51.266741 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-25b9b205-57c5-4094-8eaa-ac2723242840 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:51.282089 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-25b9b205-57c5-4094-8eaa-ac2723242840 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:51.283864 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-25b9b205-57c5-4094-8eaa-ac2723242840 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:51.285064 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-25b9b205-57c5-4094-8eaa-ac2723242840 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1281 microversion: 2.20 time: 0.279236 May 18 14:55:51.299285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 20/36] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:55:51 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:55:51.324664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-024f4db6-8f85-4f0d-946c-ddbc92e907c4 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18" status: 200 len: 345 microversion: 2.1 time: 0.196153 May 18 14:55:51.330321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 17/37] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:51 2022] GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 => generated 345 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:55:51.330497 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:51.331122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:51.368437 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:51.369985 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:51.375299 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:51.377436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:51.552444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2035559650", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:51.717505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:51.763950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] validate_networks() for [('22bd5425-6379-4740-b6c4-d6f9b7aaeddb', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:55:51.764505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d60d503c-cc98-47ba-bbc5-d450b2ab7ba0 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1272 microversion: 2.1 time: 0.405683 May 18 14:55:51.779366 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 21/38] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:51 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1272 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:52.303648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-faed1bf8-392c-43d1-b4c8-028d8961d4a5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:52.304323 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-faed1bf8-392c-43d1-b4c8-028d8961d4a5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:52.676876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-faed1bf8-392c-43d1-b4c8-028d8961d4a5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:52.702141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-faed1bf8-392c-43d1-b4c8-028d8961d4a5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:52.711845 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-faed1bf8-392c-43d1-b4c8-028d8961d4a5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:52.713720 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-faed1bf8-392c-43d1-b4c8-028d8961d4a5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1281 microversion: 2.20 time: 0.414297 May 18 14:55:52.714971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 22/39] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:55:52 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1281 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:55:52.739162 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-32209b76-4fc1-478c-9ad6-5c2231f778f1 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a1ea20d0>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:52.830847 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-32209b76-4fc1-478c-9ad6-5c2231f778f1 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] HTTP exception thrown: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-32209b76-4fc1-478c-9ad6-5c2231f778f1 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Request method failure captured: May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 HTTP/1.1 May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjoD81PkAvZ192DpuVClrRkHNSUGeb_lGAvcXxrMtprQzLWMpQr7WFMeXv2WtgXOm89ZD4mNEoWCSAocdv38wMb4OZgFduhxjbdTeqZGnDjPsTlBE3YYjVcAMKFJUub7W_5nfz2DL41JYkRFXI2dSKuQPNgcCNyWcCJBCqkHHEKGhA May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:55:52.849080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 25967732542c4a28a38b1b8a121037f1 May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '0d6550e3-81c1-41c3-9fa2-4d478b6a4c18'} May 18 14:55:52.851092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. (HTTP 404) (Request-ID: req-4656a59c-b063-4916-b84b-1110d6c0bbe5) May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:52.851930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:52.853461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 14:55:52.854635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:52.855897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:52.858620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-32209b76-4fc1-478c-9ad6-5c2231f778f1 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Returning 404 to user: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:52.859711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-32209b76-4fc1-478c-9ad6-5c2231f778f1 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18" status: 404 len: 109 microversion: 2.1 time: 0.142604 May 18 14:55:52.862814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 23/40] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:52 2022] GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:55:52.872407 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:52.878989 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:52.899978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:52.900462 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:52.901362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:52.909123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:54.019477 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:55:54.020715 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:55:54.021358 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:55:54.022013 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:55:54.023117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:55:54.044004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:54.044454 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:54.049908 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:54.055351 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:54.080741 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:54.128834 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-25beb72f-b2c7-43ee-b82f-2a21bb319744 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 1.264604 May 18 14:55:54.129476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 24/41] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:52 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:54.151818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for project 84835592358a4e188df86896d6015647. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:55:54.156546 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4d5b9d52-9df9-4deb-975c-6d0cd97cd981 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a0e10940>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:54.168667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for user 2aa34e012c824754833a12ac66413aaf and project 84835592358a4e188df86896d6015647. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:55:54.300141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-4d5b9d52-9df9-4deb-975c-6d0cd97cd981 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] HTTP exception thrown: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4d5b9d52-9df9-4deb-975c-6d0cd97cd981 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Request method failure captured: May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 HTTP/1.1 May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjoD81PkAvZ192DpuVClrRkHNSUGeb_lGAvcXxrMtprQzLWMpQr7WFMeXv2WtgXOm89ZD4mNEoWCSAocdv38wMb4OZgFduhxjbdTeqZGnDjPsTlBE3YYjVcAMKFJUub7W_5nfz2DL41JYkRFXI2dSKuQPNgcCNyWcCJBCqkHHEKGhA May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:55:54.302143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 25967732542c4a28a38b1b8a121037f1 May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '0d6550e3-81c1-41c3-9fa2-4d478b6a4c18'} May 18 14:55:54.303244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. (HTTP 404) (Request-ID: req-011a860b-30ad-4458-8430-5a4e76c731ed) May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:54.303933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 14:55:54.304941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 14:55:54.306103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4d5b9d52-9df9-4deb-975c-6d0cd97cd981 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Returning 404 to user: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4d5b9d52-9df9-4deb-975c-6d0cd97cd981 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18" status: 404 len: 109 microversion: 2.1 time: 0.172126 May 18 14:55:54.308189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 25/42] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 14:55:54 2022] DELETE /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:55:54.309788 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:54.309788 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:54.310276 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:55:54.322939 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:55:54.326255 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:54.326712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:54.327495 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:54.327934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:54.494306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-10e376fc-657d-42a8-9897-4a816ee6d8c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.946376 May 18 14:55:54.502006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 18/43] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:55:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:55:54.512486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4819d6a1-fc93-4e74-b069-49c5b9800694 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Calling method '.version_select at 0x7fa8a164f820>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:54.588872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-4819d6a1-fc93-4e74-b069-49c5b9800694 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] HTTP exception thrown: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4819d6a1-fc93-4e74-b069-49c5b9800694 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Request method failure captured: May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 HTTP/1.1 May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjoD81PkAvZ192DpuVClrRkHNSUGeb_lGAvcXxrMtprQzLWMpQr7WFMeXv2WtgXOm89ZD4mNEoWCSAocdv38wMb4OZgFduhxjbdTeqZGnDjPsTlBE3YYjVcAMKFJUub7W_5nfz2DL41JYkRFXI2dSKuQPNgcCNyWcCJBCqkHHEKGhA May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:54.591384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_caa15bf50ba64a59b14643c504d61fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: caa15bf50ba64a59b14643c504d61fb1 May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-719881886 May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 25967732542c4a28a38b1b8a121037f1 May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-719881886-project May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '0d6550e3-81c1-41c3-9fa2-4d478b6a4c18'} May 18 14:55:54.593204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. (HTTP 404) (Request-ID: req-b0019822-f6d5-410f-9d7b-0a7d9150ed8d) May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:54.594309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:54.595857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 14:55:54.599476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4819d6a1-fc93-4e74-b069-49c5b9800694 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] Returning 404 to user: Volume 0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4819d6a1-fc93-4e74-b069-49c5b9800694 tempest-VolumesSnapshotsTestJSON-719881886 tempest-VolumesSnapshotsTestJSON-719881886-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18" status: 404 len: 109 microversion: 2.1 time: 0.087364 May 18 14:55:54.604903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 19/44] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:54 2022] GET /compute/v2.1/os-volumes/0d6550e3-81c1-41c3-9fa2-4d478b6a4c18 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:55:54.609793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4fa5cbe4-c7ad-4a3c-8c52-4de7dd73e9ed tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:54.609793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4fa5cbe4-c7ad-4a3c-8c52-4de7dd73e9ed tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:54.736813 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:54.759663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:54.763742 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:54.767019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9ed197bc-d6d0-4b14-8a30-0ed8d197104d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1333 microversion: 2.20 time: 0.459754 May 18 14:55:54.770372 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 26/45] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:55:54 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1333 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:55:55.062008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4fa5cbe4-c7ad-4a3c-8c52-4de7dd73e9ed tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:55.090135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4fa5cbe4-c7ad-4a3c-8c52-4de7dd73e9ed tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1222 microversion: 2.1 time: 0.474998 May 18 14:55:55.090965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 20/46] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:54 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1222 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:55.149849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:55.150944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:55.183455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:55.207856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:55.208855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:55.209313 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:55.789719 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:55.790720 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:55.808455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:55.812341 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:55.820043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:55.822150 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:55.948535 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:55.962929 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-85353b5a-c4d7-4a12-ba01-dce20342d7ef tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.818347 May 18 14:55:55.965506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 27/47] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:55 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:56.014458 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:56.044699 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:56.048442 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:56.052049 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2ac0b9f6-cd2b-4b5d-aa82-08ab9ee65058 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1339 microversion: 2.20 time: 0.268693 May 18 14:55:56.055766 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 21/48] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:55:55 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1339 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:55:56.111452 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:56.112067 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:56.130666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:56.133261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:56.147897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:56.151991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:56.712369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:56.727669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-65ee1276-5328-476c-bebb-03b2a1416d0c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1274 microversion: 2.1 time: 0.620099 May 18 14:55:56.752373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 28/49] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:56 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1274 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:56.987148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:56.988138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:57.003200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:57.021585 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:57.026532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:57.027502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:57.061531 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9d29425a-fb22-4437-af00-219159dbc0c8 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Action: 'create', calling method: .version_select at 0x7fa8a164ff70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1778199798", "metadata": {"Type": "work"}}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9d29425a-fb22-4437-af00-219159dbc0c8 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Request method failure captured: May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 122 May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQj8FY2iKboiT22YWUhf_eIfaJuWF8cXlZvXolE33NPE-8a18fbhK3ZcezMkEzC53rq-tP-e3Txbv1vy6_cf72GceMQsDLVyGzBALbgZm2CaOYeBiY_ZKoOyMWFMG0k00cAiKGQig-qmr54yhImXkCoTWaWaUrWRHZrSK0ipDx0sSGo May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:57.085378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesNegativeTest-1754549367 May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 430b8a27f45148c2a98985e1f1d37c14 May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1778199798", "metadata": {"Type": "work"}}} May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1778199798', 'metadata': {'Type': 'work'}}}} May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise error May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi '#$%' May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:57.087651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 14:55:57.089045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 14:55:57.090204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 14:55:57.090204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:57.090204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9d29425a-fb22-4437-af00-219159dbc0c8 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:57.090204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9d29425a-fb22-4437-af00-219159dbc0c8 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.478634 May 18 14:55:57.090204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 22/50] 10.222.0.59 () {60 vars in 1155 bytes} [Wed May 18 14:55:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 481 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 14:55:57.107997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:57.110091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:57.137896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:57.140805 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:57.146014 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:57.146563 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:58.304264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:58.326571 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:58.328682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:58.330082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-46726237-e668-4c0d-8860-6c6d2ee3ec75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1339 microversion: 2.20 time: 1.238596 May 18 14:55:58.330841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 23/51] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:55:57 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1339 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:55:58.360436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-492a6a04-ebaf-45c5-9586-05ceb0ef4443 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Action: 'create', calling method: .version_select at 0x7fa8a1658820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-505903610", "metadata": {"Type": "work"}}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-492a6a04-ebaf-45c5-9586-05ceb0ef4443 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Request method failure captured: May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 119 May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQj8FY2iKboiT22YWUhf_eIfaJuWF8cXlZvXolE33NPE-8a18fbhK3ZcezMkEzC53rq-tP-e3Txbv1vy6_cf72GceMQsDLVyGzBALbgZm2CaOYeBiY_ZKoOyMWFMG0k00cAiKGQig-qmr54yhImXkCoTWaWaUrWRHZrSK0ipDx0sSGo May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:58.363338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesNegativeTest-1754549367 May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 430b8a27f45148c2a98985e1f1d37c14 May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-505903610", "metadata": {"Type": "work"}}} May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:58.364665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-505903610', 'metadata': {'Type': 'work'}}}} May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise error May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi '0' May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:58.365453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 14:55:58.366825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 14:55:58.367968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 14:55:58.367968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.367968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-492a6a04-ebaf-45c5-9586-05ceb0ef4443 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:58.384891 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-492a6a04-ebaf-45c5-9586-05ceb0ef4443 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032896 May 18 14:55:58.389149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 24/52] 10.222.0.59 () {60 vars in 1155 bytes} [Wed May 18 14:55:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 14:55:58.406695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:58.412285 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:58.429673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:58.430133 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:58.439191 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:58.440174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:58.675443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:58.691412 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d41592a3-712c-410e-ae1e-028394d5a136 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1280 microversion: 2.1 time: 0.298752 May 18 14:55:58.694263 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 25/53] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:58 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:55:58.706488 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6861587d-65fe-409e-bd8b-d867156f6984 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Action: 'create', calling method: .version_select at 0x7fa8a16b7550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2099170342", "metadata": {"Type": "work"}}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6861587d-65fe-409e-bd8b-d867156f6984 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Request method failure captured: May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 119 May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQj8FY2iKboiT22YWUhf_eIfaJuWF8cXlZvXolE33NPE-8a18fbhK3ZcezMkEzC53rq-tP-e3Txbv1vy6_cf72GceMQsDLVyGzBALbgZm2CaOYeBiY_ZKoOyMWFMG0k00cAiKGQig-qmr54yhImXkCoTWaWaUrWRHZrSK0ipDx0sSGo May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:58.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesNegativeTest-1754549367 May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 430b8a27f45148c2a98985e1f1d37c14 May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2099170342", "metadata": {"Type": "work"}}} May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:58.711950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2099170342', 'metadata': {'Type': 'work'}}}} May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise error May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi '' May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:58.713267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 14:55:58.714636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 14:55:58.715937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 14:55:58.715937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:58.722539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6861587d-65fe-409e-bd8b-d867156f6984 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:58.726654 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6861587d-65fe-409e-bd8b-d867156f6984 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029342 May 18 14:55:58.731714 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 26/54] 10.222.0.59 () {60 vars in 1155 bytes} [Wed May 18 14:55:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 14:55:58.911318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-27a45c47-6448-4643-8aab-30dd4a736b23 req-9b8dadae-61c2-419b-9413-2798ed0d80ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211fbe03-a0bd-49d9-a86f-3a4147d3a696", "tag": "aa22c1c3-af67-444a-95d8-fc498125658c"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:55:58.951714 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-27a45c47-6448-4643-8aab-30dd4a736b23 req-9b8dadae-61c2-419b-9413-2798ed0d80ec service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:58.952946 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-27a45c47-6448-4643-8aab-30dd4a736b23 req-9b8dadae-61c2-419b-9413-2798ed0d80ec service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:59.030753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-27a45c47-6448-4643-8aab-30dd4a736b23 req-9b8dadae-61c2-419b-9413-2798ed0d80ec service nova] Creating event network-changed:aa22c1c3-af67-444a-95d8-fc498125658c for instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 on hv-cinder-83998 May 18 14:55:59.031631 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-27a45c47-6448-4643-8aab-30dd4a736b23 req-9b8dadae-61c2-419b-9413-2798ed0d80ec service nova] Acquired lock "compute-rpcapi-router" {{(pid=123865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 18 14:55:59.034400 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:59.036098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:59.037465 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:59.049306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:59.061372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.compute.rpcapi [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 18 14:55:59.062523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] Releasing lock "compute-rpcapi-router" {{(pid=123865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 18 14:55:59.106263 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4d599a70-25cc-4529-97a8-d933efae56b3 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371777 May 18 14:55:59.108123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 27/55] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:55:59.116008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d4167aea-894b-43b2-9eee-d24af6344415 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Calling method '.version_select at 0x7fa8a164ab80>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:59.174132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-d4167aea-894b-43b2-9eee-d24af6344415 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] HTTP exception thrown: Volume tempest-invalid-2095558546 could not be found. May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d4167aea-894b-43b2-9eee-d24af6344415 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Request method failure captured: May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2095558546 HTTP/1.1 May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQj8FY2iKboiT22YWUhf_eIfaJuWF8cXlZvXolE33NPE-8a18fbhK3ZcezMkEzC53rq-tP-e3Txbv1vy6_cf72GceMQsDLVyGzBALbgZm2CaOYeBiY_ZKoOyMWFMG0k00cAiKGQig-qmr54yhImXkCoTWaWaUrWRHZrSK0ipDx0sSGo May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:59.176813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 430b8a27f45148c2a98985e1f1d37c14 May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Volume tempest-invalid-2095558546 could not be found. May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'tempest-invalid-2095558546'} May 18 14:55:59.178439 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2095558546 could not be found. (HTTP 404) (Request-ID: req-03095566-77b9-4bec-b590-667f97cb5062) May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.179236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 14:55:59.180381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2095558546 could not be found. May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:59.181608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2095558546 could not be found. May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2095558546 could not be found. May 18 14:55:59.182836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.185734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d4167aea-894b-43b2-9eee-d24af6344415 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Returning 404 to user: Volume tempest-invalid-2095558546 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:59.186936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d4167aea-894b-43b2-9eee-d24af6344415 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2095558546" status: 404 len: 99 microversion: 2.1 time: 0.076417 May 18 14:55:59.187954 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 28/56] 10.222.0.59 () {58 vars in 1217 bytes} [Wed May 18 14:55:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2095558546 => generated 99 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 18 14:55:59.200004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-24ba977a-d6e6-4432-9d8f-7647f5476c4a tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007139 May 18 14:55:59.200787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 29/57] 10.222.0.59 () {58 vars in 1139 bytes} [Wed May 18 14:55:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 18 14:55:59.215134 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1903038d-8395-45e2-b90f-6c1b97867f45 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009022 May 18 14:55:59.218727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 30/58] 10.222.0.59 () {58 vars in 1136 bytes} [Wed May 18 14:55:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 18 14:55:59.230385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-15f9cb21-af8d-4ebd-a2f9-149602c36528 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Calling method '.version_select at 0x7fa8a164fe50>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:59.276537 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:55:59.287603 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-15f9cb21-af8d-4ebd-a2f9-149602c36528 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] HTTP exception thrown: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. May 18 14:55:59.288263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0e1927d1-036c-49d0-95ae-43fbcc2420aa tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 2.309178 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-15f9cb21-af8d-4ebd-a2f9-149602c36528 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Request method failure captured: May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: DELETE /compute/v2.1/os-volumes/b5721d94-7aa8-4afd-95e4-8e90baf10c90 HTTP/1.1 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQj8FY2iKboiT22YWUhf_eIfaJuWF8cXlZvXolE33NPE-8a18fbhK3ZcezMkEzC53rq-tP-e3Txbv1vy6_cf72GceMQsDLVyGzBALbgZm2CaOYeBiY_ZKoOyMWFMG0k00cAiKGQig-qmr54yhImXkCoTWaWaUrWRHZrSK0ipDx0sSGo May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:59.290117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 430b8a27f45148c2a98985e1f1d37c14 May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'b5721d94-7aa8-4afd-95e4-8e90baf10c90'} May 18 14:55:59.291287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. (HTTP 404) (Request-ID: req-b6802f97-5df7-46c6-8b3d-d281aea15a93) May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.291976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 14:55:59.293182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 14:55:59.294552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-15f9cb21-af8d-4ebd-a2f9-149602c36528 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Returning 404 to user: Volume b5721d94-7aa8-4afd-95e4-8e90baf10c90 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-15f9cb21-af8d-4ebd-a2f9-149602c36528 tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/b5721d94-7aa8-4afd-95e4-8e90baf10c90" status: 404 len: 109 microversion: 2.1 time: 0.069023 May 18 14:55:59.295594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 31/59] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 14:55:59 2022] DELETE /compute/v2.1/os-volumes/b5721d94-7aa8-4afd-95e4-8e90baf10c90 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:55:59.296900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 29/60] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:56 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:55:59.301519 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b79effe8-ac8f-4606-be56-78978b1854dd tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Calling method '.version_select at 0x7fa8a1658e50>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:59.349169 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:59.350132 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:59.360183 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:59.365314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-b79effe8-ac8f-4606-be56-78978b1854dd tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] HTTP exception thrown: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. May 18 14:55:59.366498 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:59.367482 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b79effe8-ac8f-4606-be56-78978b1854dd tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Request method failure captured: May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/os-volumes/0b31c280-18b7-4bf7-89af-5dd301c07797 HTTP/1.1 May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQj8FY2iKboiT22YWUhf_eIfaJuWF8cXlZvXolE33NPE-8a18fbhK3ZcezMkEzC53rq-tP-e3Txbv1vy6_cf72GceMQsDLVyGzBALbgZm2CaOYeBiY_ZKoOyMWFMG0k00cAiKGQig-qmr54yhImXkCoTWaWaUrWRHZrSK0ipDx0sSGo May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:55:59.367707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2650835410cd4b8fb7c14b0c6f075729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 2650835410cd4b8fb7c14b0c6f075729 May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesNegativeTest-1754549367 May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 430b8a27f45148c2a98985e1f1d37c14 May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesNegativeTest-1754549367-project May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '0b31c280-18b7-4bf7-89af-5dd301c07797'} May 18 14:55:59.368995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. (HTTP 404) (Request-ID: req-8cd4efc4-690a-4091-84e2-3904405f8391) May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.369791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 14:55:59.371506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 14:55:59.372643 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b79effe8-ac8f-4606-be56-78978b1854dd tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] Returning 404 to user: Volume 0b31c280-18b7-4bf7-89af-5dd301c07797 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b79effe8-ac8f-4606-be56-78978b1854dd tempest-VolumesNegativeTest-1754549367 tempest-VolumesNegativeTest-1754549367-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0b31c280-18b7-4bf7-89af-5dd301c07797" status: 404 len: 109 microversion: 2.1 time: 0.072010 May 18 14:55:59.373700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 32/61] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 14:55:59 2022] GET /compute/v2.1/os-volumes/0b31c280-18b7-4bf7-89af-5dd301c07797 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 14:55:59.374863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:59.733561 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:55:59.737831 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:55:59.770516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:59.771352 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:55:59.777270 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:55:59.781606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:00.517628 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:00.527963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:00.535713 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-828556ca-c8fd-44ef-8178-4aa603c85aaf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1280 microversion: 2.1 time: 0.827175 May 18 14:56:00.546433 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 33/62] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:55:59 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1280 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:00.547959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:00.550231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:00.551655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:00.552457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:00.554705 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1fd436b5-9008-40ac-832d-a3078c65c8da tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 1.209882 May 18 14:56:00.571671 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 30/63] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:55:59 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:00.599056 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:00.599541 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:00.600928 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:00.606953 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:01.239717 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:01.249544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3bd1ad31-ac7f-4e73-852b-875cca352211 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.701956 May 18 14:56:01.254228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 34/64] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:00 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:01.555026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:01.556241 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:01.559655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:01.577773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:01.579136 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:01.581212 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:01.588543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:01.590221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:01.592734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:01.603940 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:01.603940 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:01.610974 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:01.614302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:02.632544 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:02.648916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-daaa02e3-33da-45b6-bdae-dc645cf526e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1280 microversion: 2.1 time: 1.098672 May 18 14:56:02.656239 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 31/65] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:01 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1280 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:02.677031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-ab01e097-84d2-42c7-b27c-1faa21dd8682 req-b58658e2-9c3a-46ba-b19a-ccd9ee06df26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447f7721-8ce1-4cbe-996a-75b2426474bc", "tag": "57d2f680-f45f-4e76-83e5-1b16aa578a8c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:02.719901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=16 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:02.741185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ab01e097-84d2-42c7-b27c-1faa21dd8682 req-b58658e2-9c3a-46ba-b19a-ccd9ee06df26 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:02.742211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ab01e097-84d2-42c7-b27c-1faa21dd8682 req-b58658e2-9c3a-46ba-b19a-ccd9ee06df26 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:02.794444 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-ab01e097-84d2-42c7-b27c-1faa21dd8682 req-b58658e2-9c3a-46ba-b19a-ccd9ee06df26 service nova] Creating event network-changed:57d2f680-f45f-4e76-83e5-1b16aa578a8c for instance 447f7721-8ce1-4cbe-996a-75b2426474bc on hv-cinder-83998 May 18 14:56:02.795300 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ab01e097-84d2-42c7-b27c-1faa21dd8682 req-b58658e2-9c3a-46ba-b19a-ccd9ee06df26 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 18 14:56:02.797831 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:02.799205 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:02.819057 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:02.820566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:02.845798 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.compute.rpcapi [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 18 14:56:02.852462 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] Releasing lock "compute-rpcapi-router" {{(pid=123864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 18 14:56:02.902989 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3932db27-a340-47a0-95f6-b8d59da05ef9 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244707 May 18 14:56:02.904190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 32/66] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:02.909722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:02.910749 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:02.979649 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:02.981063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:02.985692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:02.988934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:03.751421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:03.769055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:03.778198 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:03.782789 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2ef544c9-6149-4c93-9b6f-b5048f92ec59 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 2.211759 May 18 14:56:03.784093 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 35/67] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:01 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:03.806805 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:03.809485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:03.828908 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:03.837716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:03.838679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:03.844099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:03.863780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:03.868895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-fed77dc1-53c5-45b0-a711-ab0126768830 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.962273 May 18 14:56:03.883679 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 33/68] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:02 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:04.091300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:04.105339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-934db8c1-9236-4ae5-ad1c-3ef15ece15c5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1280 microversion: 2.1 time: 0.317067 May 18 14:56:04.107657 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 36/69] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:03 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:04.809808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:04.810418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:04.821846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:04.822313 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:04.823361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:04.823996 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:04.889396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:04.890609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:04.898651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:04.899549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:04.901013 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:04.902042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:05.071295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=24 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:05.134886 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:05.143202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:05.145087 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:05.146219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-97a1ee89-8dff-4c10-8b5d-17de621b15b6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.340717 May 18 14:56:05.157856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 34/70] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:04 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:05.297610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:05.315086 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3b251b14-217f-428c-8651-25400e348499 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.429348 May 18 14:56:05.323498 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 37/71] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:04 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:05.342424 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:05.343392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:05.364978 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:05.365553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:05.369111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:05.369574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:05.478100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-2989b760-9554-4ebc-ae10-103b0b70d134 req-d773d87f-c73b-46a3-9a55-5e14305c2d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:05.488098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2989b760-9554-4ebc-ae10-103b0b70d134 req-d773d87f-c73b-46a3-9a55-5e14305c2d87 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:05.488546 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2989b760-9554-4ebc-ae10-103b0b70d134 req-d773d87f-c73b-46a3-9a55-5e14305c2d87 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:05.530759 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-2989b760-9554-4ebc-ae10-103b0b70d134 req-d773d87f-c73b-46a3-9a55-5e14305c2d87 service nova] Creating event network-changed:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:56:05.543973 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-2989b760-9554-4ebc-ae10-103b0b70d134 req-d773d87f-c73b-46a3-9a55-5e14305c2d87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384800 May 18 14:56:05.545038 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 35/72] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:05.914519 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:05.917147 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=75 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:05.931962 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5f9f62e8-7471-47e3-9e20-b287dc9497d7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.606227 May 18 14:56:05.932563 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 38/73] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:05 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:06.165602 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:06.166302 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:06.177126 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:06.177582 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:06.178926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:06.179365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:06.334140 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:06.335322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:06.348761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:06.354549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:06.355446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:06.357757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:06.359139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:06.612484 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:06.625888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:06.631173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:06.635311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-fe03511c-76e6-4f42-b2c6-51c300babaed tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.474521 May 18 14:56:06.638024 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 36/74] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:06 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:06.662206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:06.681584 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-eb18540c-348d-490e-a729-4670b714547b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.351565 May 18 14:56:06.701790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 39/75] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:06 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:06.949342 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:06.949964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:06.952173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:06.962248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:06.963100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:06.966275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:06.967033 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:07.641520 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:07.658851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:07.660691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:07.670056 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9b2277ee-7b84-47f4-b63c-a6f35b3eac92 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.720293 May 18 14:56:07.679950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 37/76] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:06 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:07.680226 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:07.680226 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:07.680226 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:07.680226 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:07.700210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:07.701876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:07.715435 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:07.718571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:07.721012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:07.724969 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:08.240217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:08.253089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:08.254916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:08.256375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d3cd981a-e281-43a8-acbf-9f78b70f5f05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.603478 May 18 14:56:08.257587 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 40/77] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:07 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:08.262178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-e0adce11-6f92-4a9a-93e0-164d38c692a4 req-fa89d023-81f8-4dfe-a5ee-3c4dbf4e15af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f6cf5f-5077-4b01-9a99-ffe0f7a20a17", "tag": "be1a0b48-9f78-477a-a06b-50518f954982"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:08.271597 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e0adce11-6f92-4a9a-93e0-164d38c692a4 req-fa89d023-81f8-4dfe-a5ee-3c4dbf4e15af service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:08.272078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e0adce11-6f92-4a9a-93e0-164d38c692a4 req-fa89d023-81f8-4dfe-a5ee-3c4dbf4e15af service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:08.288896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-e0adce11-6f92-4a9a-93e0-164d38c692a4 req-fa89d023-81f8-4dfe-a5ee-3c4dbf4e15af service nova] Creating event network-changed:be1a0b48-9f78-477a-a06b-50518f954982 for instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 on hv-cinder-83998 May 18 14:56:08.289426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:08.294982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-e0adce11-6f92-4a9a-93e0-164d38c692a4 req-fa89d023-81f8-4dfe-a5ee-3c4dbf4e15af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036045 May 18 14:56:08.295920 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 41/78] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:08.301490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-aecc9fdf-b247-42fa-948f-6a6d2850c0fc tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.605359 May 18 14:56:08.302089 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 38/79] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:07 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:08.687971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:08.688685 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:08.704316 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:08.704791 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:08.705722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:08.706350 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:09.018092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:09.031741 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8573b75b-2e0e-4e39-8489-86112b1c995e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.346830 May 18 14:56:09.031741 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 42/80] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:08 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:09.279201 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:09.280791 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:09.291190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:09.291646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:09.292429 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:09.292905 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:09.320686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:09.321607 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:09.326083 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=8 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:09.340785 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:09.342116 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:09.344041 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:09.345329 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:09.715001 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:09.723830 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:09.726130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:09.727687 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d3dff26b-9cec-483f-bd88-36f44ae7b5ae tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.453006 May 18 14:56:09.729328 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 39/81] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:09 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:09.740926 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:09.750147 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-de0f71e9-3b4d-4801-aeb0-219c3fa6a8e4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.435579 May 18 14:56:09.750846 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 43/82] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:09 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:10.048252 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:10.049133 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:10.065272 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:10.065770 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:10.066930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:10.070496 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:10.102806 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:10.304029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:10.313643 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d4a38a49-ec92-461c-af7d-9f1f459eeb54 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.270141 May 18 14:56:10.314335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 40/83] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:10 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:10.750026 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:10.751238 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:10.760080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:10.760691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:10.761658 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:10.768248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:10.769368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:10.774436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:10.781246 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:10.782234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:10.783469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:10.784835 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:11.029100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:11.040564 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-79187ea2-479a-4e3d-837c-08862277c957 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.277165 May 18 14:56:11.054418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 41/84] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:10 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:11.073724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:11.106314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:11.108370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:11.110150 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e40e4c1d-95a8-4a06-9ea8-c4a0ad2dba08 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.366123 May 18 14:56:11.121495 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 44/85] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:10 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:11.330881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:11.331493 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:11.340286 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:11.340932 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:11.341711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:11.342302 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:11.554655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:11.565276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-dec92517-c027-488b-95fc-3b6ddce9f9b5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.238118 May 18 14:56:11.576756 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 42/86] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:11 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:12.058573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:12.059187 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:12.065130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:12.065579 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:12.066339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:12.066782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:12.127211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:12.127821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:12.133895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:12.134412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:12.135220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:12.135654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:12.250730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:12.258599 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2c0ec297-39d2-4e09-b826-d16e84b448a9 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.203781 May 18 14:56:12.259660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 45/87] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:12 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:12.308785 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:12.320574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:12.322120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:12.323242 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ee61a77f-f971-4a5c-a781-5a97fa18353c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.199944 May 18 14:56:12.324005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 43/88] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:12 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:12.584875 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:12.585832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:12.593159 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:12.595564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:12.596360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:12.596820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:12.900936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:12.906413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:12.931660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8b5de9b8-dd05-411e-8346-ae5aded06e73 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.351692 May 18 14:56:12.944751 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 46/89] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:12 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:13.092675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-e2718b5f-270c-47e0-aefa-fad632d17c57 req-3359617e-b5c1-4176-8895-9044b9989b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211fbe03-a0bd-49d9-a86f-3a4147d3a696", "name": "network-vif-plugged", "status": "completed", "tag": "aa22c1c3-af67-444a-95d8-fc498125658c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:13.102545 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-e2718b5f-270c-47e0-aefa-fad632d17c57 req-3359617e-b5c1-4176-8895-9044b9989b24 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.103071 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-e2718b5f-270c-47e0-aefa-fad632d17c57 req-3359617e-b5c1-4176-8895-9044b9989b24 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:13.116711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-e2718b5f-270c-47e0-aefa-fad632d17c57 req-3359617e-b5c1-4176-8895-9044b9989b24 service nova] Creating event network-vif-plugged:aa22c1c3-af67-444a-95d8-fc498125658c for instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 on hv-cinder-83998 May 18 14:56:13.129776 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-e2718b5f-270c-47e0-aefa-fad632d17c57 req-3359617e-b5c1-4176-8895-9044b9989b24 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224358 May 18 14:56:13.130565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 44/90] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:13.276727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:13.277339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:13.284299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.284881 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:13.285807 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.286400 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:13.347254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:13.349594 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:13.359461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.360677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:13.362263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.362723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:13.492239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:13.500723 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-782f3a5b-7c67-4984-b74b-05a6693397f3 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.227252 May 18 14:56:13.501780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 47/91] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:13 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:13.558883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:13.567120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:13.569546 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:13.570798 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6953881a-0232-46a1-a5df-b347e3879be3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.229388 May 18 14:56:13.571463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 45/92] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:13 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:13.949929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:13.950728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:13.956867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.957492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:13.958259 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:13.958691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:14.089971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:14.097473 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b3734f71-608b-41c3-83a5-694ca029e3c9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.151275 May 18 14:56:14.098062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 48/93] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:13 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:14.518796 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:14.519427 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:14.526125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:14.526582 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:14.527345 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:14.527985 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:14.589303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:14.589936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:14.595989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:14.596534 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:14.597417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:14.597925 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:14.698568 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:14.706009 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-663113ec-2588-4955-8da8-963f6395b00f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.191535 May 18 14:56:14.706574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 46/94] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:14 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:14.742268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:14.750274 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:14.751793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:14.752924 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cde0c172-726f-4227-8865-85270be7f925 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.167587 May 18 14:56:14.753481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 49/95] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:14 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:15.114195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:15.114812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:15.120998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:15.121449 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:15.122211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:15.122645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:15.249014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:15.257684 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a52c67ae-f5b2-4330-b50a-2707d60bf8ee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.147366 May 18 14:56:15.258253 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 47/96] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:15 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:15.726491 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:15.728333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:15.749634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:15.750443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:15.752195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:15.753894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:15.775154 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:15.776110 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:15.784143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:15.784782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:15.785995 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:15.786630 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:16.091840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:16.104237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a0a95388-bf66-48a8-a0fa-460353cc828f tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.384654 May 18 14:56:16.105416 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 50/97] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:15 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:16.140487 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:16.153172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:16.157440 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:16.159718 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5b6cd38d-bfd4-47ee-be5b-e07f7d90c5a8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.392397 May 18 14:56:16.164873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 48/98] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:15 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:16.274626 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:16.275240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:16.282079 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:16.282539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:16.283306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:16.292416 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:16.497057 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:16.505374 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9e8bda22-3f72-49ba-be0d-d7d88b266416 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.234976 May 18 14:56:16.506473 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 51/99] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:16 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:17.121974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:17.124858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:17.130999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:17.132264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:17.133204 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:17.133638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:17.187918 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:17.188524 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:17.203254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:17.203686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:17.204633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:17.205199 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:17.357039 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:17.366176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-02487aa5-e0aa-42d1-ab39-7eb95c600dfd tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.247394 May 18 14:56:17.366927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 49/100] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:17 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:17.414383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:17.423483 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:17.425873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:17.427279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0570de47-2d2b-43d0-9941-a5523d7a6bc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.245893 May 18 14:56:17.428030 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 52/101] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:17 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:17.524225 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:17.525017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:17.531978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:17.532889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:17.533992 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:17.534614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:17.746214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:17.755653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f72e3242-0216-4c76-af48-65f279ce7624 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.236385 May 18 14:56:17.756790 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 50/102] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:17 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:18.387403 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:18.389012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:18.395478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:18.395923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:18.396753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:18.397185 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:18.445502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:18.446094 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:18.455395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:18.456051 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:18.457103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:18.457711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:18.986526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:18.997231 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-456aa398-a079-4ebc-803d-8fdeabb96618 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.615929 May 18 14:56:18.997973 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 53/103] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:18 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:19.002572 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:19.003249 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:19.009999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:19.010445 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:19.011583 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:19.012310 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:19.025529 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:19.044671 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:19.046852 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:19.047955 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e4f92ec9-ef27-48a3-9699-2e5d1be4b2d6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.607059 May 18 14:56:19.057270 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 51/104] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:18 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:19.409863 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:19.421921 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e2d2adfa-d97f-44c1-a7f9-4c51c8b6d10c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.421779 May 18 14:56:19.422845 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 54/105] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:18 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:19.932601 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-3d02ab5a-eb1f-430b-9e09-12bfa3b365e5 req-12c3e79b-4317-4357-b627-63af932de125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447f7721-8ce1-4cbe-996a-75b2426474bc", "name": "network-vif-plugged", "status": "completed", "tag": "57d2f680-f45f-4e76-83e5-1b16aa578a8c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:19.946731 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-3d02ab5a-eb1f-430b-9e09-12bfa3b365e5 req-12c3e79b-4317-4357-b627-63af932de125 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:19.947317 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-3d02ab5a-eb1f-430b-9e09-12bfa3b365e5 req-12c3e79b-4317-4357-b627-63af932de125 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:19.969944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-3d02ab5a-eb1f-430b-9e09-12bfa3b365e5 req-12c3e79b-4317-4357-b627-63af932de125 service nova] Creating event network-vif-plugged:57d2f680-f45f-4e76-83e5-1b16aa578a8c for instance 447f7721-8ce1-4cbe-996a-75b2426474bc on hv-cinder-83998 May 18 14:56:19.977030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-3d02ab5a-eb1f-430b-9e09-12bfa3b365e5 req-12c3e79b-4317-4357-b627-63af932de125 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048862 May 18 14:56:19.978321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 52/106] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:56:20.015982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:20.016847 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:20.025842 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:20.028418 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:20.030581 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:20.033118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:20.075591 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:20.076503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:20.085565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:20.086231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:20.087158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:20.087780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:20.377904 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:20.382522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:20.386021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-240ca062-3e29-4162-8d85-833eb001bae4 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.374923 May 18 14:56:20.386662 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 55/107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:20 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:20.402966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:20.404833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:20.406163 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-94e37248-b457-4c35-bf40-6c01b85aaa7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.344272 May 18 14:56:20.407215 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 53/108] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:20 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:20.440645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:20.442001 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:20.451022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:20.453408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:20.455114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:20.456560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:20.495327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=100 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:20.659225 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:20.669054 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b06098b2-b65d-45de-99e0-650ff5adb8a3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.233182 May 18 14:56:20.670155 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 56/109] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:20 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:21.402824 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:21.403618 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:21.411825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:21.412730 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:21.413598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:21.414103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:21.424392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:21.426379 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:21.438855 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:21.441173 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:21.442761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:21.445956 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:21.660887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:21.672172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-87cfaacf-21f5-488a-b2b5-7671ee2741d6 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.273239 May 18 14:56:21.676599 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:21.681673 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 54/110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:21 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:21.687397 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:21.688961 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:21.690068 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0296d8a0-8b4f-4215-b609-991161c19061 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.269536 May 18 14:56:21.690626 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 57/111] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:21 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:21.696337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:21.697319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:21.704664 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:21.705222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:21.706193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:21.706628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:21.852322 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:21.862330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4af14005-ee04-4a42-8ac8-bc3c5b0d9c94 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.179631 May 18 14:56:21.862979 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 55/112] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:21 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:22.708909 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:22.710911 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:22.711141 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:22.712305 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:22.723257 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:22.730757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:22.730873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:22.730873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:22.730873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:22.731163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:22.732142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:22.732882 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:23.003689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:23.014913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:23.016458 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:23.017614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3edc11cf-e553-48db-a33d-2817b58bd479 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.314334 May 18 14:56:23.021068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 56/113] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:22 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:23.033194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:23.034953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:23.048509 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:23.051203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:23.054441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:23.055245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:23.056163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:23.066380 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d282a3a6-cec7-43bd-8f7e-8eb987878f42 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1314 microversion: 2.1 time: 0.370767 May 18 14:56:23.077501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 58/114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:22 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:23.223908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:23.234175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-985a7069-588b-491c-b0f9-ea9e2261f969 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.209351 May 18 14:56:23.234811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 57/115] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:23 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:23.968118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-3599d219-6a57-4da7-b1cf-0ba859275811 req-66602e41-c3a1-4726-9123-e3c6925fd8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "name": "network-vif-plugged", "status": "completed", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:23.992330 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-3599d219-6a57-4da7-b1cf-0ba859275811 req-66602e41-c3a1-4726-9123-e3c6925fd8f9 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:23.992816 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-3599d219-6a57-4da7-b1cf-0ba859275811 req-66602e41-c3a1-4726-9123-e3c6925fd8f9 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.011985 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-3599d219-6a57-4da7-b1cf-0ba859275811 req-66602e41-c3a1-4726-9123-e3c6925fd8f9 service nova] Creating event network-vif-plugged:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:56:24.019747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-3599d219-6a57-4da7-b1cf-0ba859275811 req-66602e41-c3a1-4726-9123-e3c6925fd8f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056343 May 18 14:56:24.020933 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 59/116] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:24.035523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:24.036405 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:24.045480 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:24.046195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.047164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:24.047822 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.055668 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:24.087788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:24.088637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:24.103299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:24.103702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.107295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:24.107759 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.393351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:24.402682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:24.410871 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:24.412138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f2653fd8-4904-4907-8e2a-4b6afa0d7342 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.380549 May 18 14:56:24.422277 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 58/117] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:24 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:24.426502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:24.427115 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:24.437121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:24.437572 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.438521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:24.439066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:24.439512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:24.453688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-be248220-1cff-425a-aa91-526f06c2b13b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1502 microversion: 2.1 time: 0.373163 May 18 14:56:24.454844 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 60/118] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:24 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1502 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:24.658335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:24.669459 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f51b4955-2c44-419c-9ddf-e47ceb268ff3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.255269 May 18 14:56:24.684442 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 59/119] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:24 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:25.431850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:25.432472 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:25.444446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:25.444446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:25.444446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:25.444742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:25.701824 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:25.703227 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:25.720230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:25.720923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:25.721900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:25.722494 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:25.781404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:25.791153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:25.792710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:25.793983 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9ce18b11-db98-4f2c-a591-d5b30b4404e5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.367780 May 18 14:56:25.794710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 61/120] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:25 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:25.922480 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:25.936510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d1401dac-7f4a-4173-b1a9-4f7ebd1c1065 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.234525 May 18 14:56:25.937367 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 60/121] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:25 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:26.032685 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b341650-f8f8-4876-b81c-11a3591a01ab"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:26.033918 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:26.041265 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:26.041721 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:26.042550 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:26.043147 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:26.079879 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-6978fb57-6fef-4c42-8bfe-9055c3a5c784 req-51dee01f-1a25-4558-be38-9201c240755d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f6cf5f-5077-4b01-9a99-ffe0f7a20a17", "name": "network-vif-plugged", "status": "completed", "tag": "be1a0b48-9f78-477a-a06b-50518f954982"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:26.093985 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-6978fb57-6fef-4c42-8bfe-9055c3a5c784 req-51dee01f-1a25-4558-be38-9201c240755d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:26.097154 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-6978fb57-6fef-4c42-8bfe-9055c3a5c784 req-51dee01f-1a25-4558-be38-9201c240755d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:26.125331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-6978fb57-6fef-4c42-8bfe-9055c3a5c784 req-51dee01f-1a25-4558-be38-9201c240755d service nova] Creating event network-vif-plugged:be1a0b48-9f78-477a-a06b-50518f954982 for instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 on hv-cinder-83998 May 18 14:56:26.135809 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-6978fb57-6fef-4c42-8bfe-9055c3a5c784 req-51dee01f-1a25-4558-be38-9201c240755d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059614 May 18 14:56:26.136414 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 61/122] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:56:26.814932 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:26.816296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:26.824469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:26.825241 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:26.826220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:26.826915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:27.034360 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:27.053191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:27.056008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:27.058496 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5bbbdc85-0010-4455-b99d-cd3c350e602a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.249624 May 18 14:56:27.066157 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 62/123] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:26 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:27.071315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:27.072178 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:27.079396 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:27.080063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:27.088486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:27.090069 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:27.317046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:27.325718 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-aaaf51e0-6255-410e-9bc4-72aeabf5abbb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.258266 May 18 14:56:27.326285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 63/124] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:27 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:28.079264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:28.081048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:28.088802 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:28.089519 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:28.090298 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:28.091114 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:28.243048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:28.256840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:28.258732 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:28.259861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ce8fa9e2-aa6c-4f50-aa75-660fd13eccc0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.186101 May 18 14:56:28.266204 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 64/125] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:28 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:28.342926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:28.343550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:28.349929 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:28.350379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:28.351165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:28.351554 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:28.516156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:28.524339 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c9e13ce1-4471-41d4-a141-7ae3c9a65688 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.185285 May 18 14:56:28.524935 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 65/126] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:28 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:29.278274 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:29.278887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:29.284877 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:29.285332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:29.286095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:29.286534 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:29.441095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:29.450745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:29.452604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:29.453724 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f259e4ec-66d5-4330-908c-fdac9753735e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.179393 May 18 14:56:29.454294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 66/127] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:29 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:56:29.542183 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:29.542790 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:29.549086 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:29.549766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:29.550793 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:29.551492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:29.551955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7e610e19-4be4-4954-8047-61aace7ab72b tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "POST /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.523119 May 18 14:56:29.552963 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 62/128] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 14:56:26 2022] POST /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696/os-volume_attachments => generated 194 bytes in 3525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:29.720152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:29.727618 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-88c7d58f-aa2c-4e5e-b6cf-17f3e1360426 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.189552 May 18 14:56:29.728182 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 67/129] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:29 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:30.474034 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:30.475554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:30.482530 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:30.483369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:30.484299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:30.484770 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:30.640356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:30.650437 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:30.651972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:30.653250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-73e217e2-7cec-47df-b9a7-a3e17b71579c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1406 microversion: 2.20 time: 0.184129 May 18 14:56:30.653815 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 63/130] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:30 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:30.745311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:30.746583 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:30.753250 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:30.753613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:30.754373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:30.754807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:30.903530 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:30.912269 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d863f741-812f-4f36-b22b-5bdb3f35d701 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.171413 May 18 14:56:30.913508 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 68/131] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:30 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:31.671261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:31.671877 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:31.678604 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:31.679073 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:31.679860 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:31.680293 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:31.826349 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:31.835415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:31.836941 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:31.838093 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-33c14c10-2930-4bf6-be51-81b85270bf3e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1597 microversion: 2.20 time: 0.170689 May 18 14:56:31.838630 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 64/132] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:56:31 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:56:31.856015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:31.856477 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:31.862735 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:31.863184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:31.863941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:31.864370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:31.930072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:31.930690 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:31.936859 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:31.937302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:31.938089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:31.938518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:32.018637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-02c4fca0-703b-4a10-bcc1-d09a6f80ce0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.166454 May 18 14:56:32.019447 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 69/133] 10.222.0.59 () {60 vars in 1315 bytes} [Wed May 18 14:56:31 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:56:32.095723 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:32.102967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0cc9466b-0644-4bad-a56b-6ceb062abcf0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.176752 May 18 14:56:32.103616 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 65/134] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:31 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:33.119049 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:33.119666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:33.126292 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:33.126744 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:33.127608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:33.128108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:33.278757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:33.286557 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2f1ee943-6f45-451a-91e9-444d50ff8956 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.171194 May 18 14:56:33.287968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 70/135] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:33 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:33.362184 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-28176851-8faf-43c5-8e99-ab5847a3763a req-928791db-bb66-46d9-858b-664296e78886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:33.371339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-28176851-8faf-43c5-8e99-ab5847a3763a req-928791db-bb66-46d9-858b-664296e78886 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:33.371848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-28176851-8faf-43c5-8e99-ab5847a3763a req-928791db-bb66-46d9-858b-664296e78886 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:33.387850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-28176851-8faf-43c5-8e99-ab5847a3763a req-928791db-bb66-46d9-858b-664296e78886 service nova] Creating event network-changed:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:56:33.392820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-28176851-8faf-43c5-8e99-ab5847a3763a req-928791db-bb66-46d9-858b-664296e78886 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034450 May 18 14:56:33.393697 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 66/136] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:56:34.304759 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:34.305392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:34.311349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:34.311784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:34.312532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:34.312984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:34.454627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:34.462521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d909c3e1-e54c-4404-a6cd-0728300f0dee tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.162501 May 18 14:56:34.463092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 71/137] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:34 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:35.480771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:35.481502 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:35.488115 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:35.488565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:35.489346 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:35.489782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:35.618760 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:35.626324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-960cd274-db40-47ba-841a-48a595261ea3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.150202 May 18 14:56:35.626898 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 67/138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:35 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:36.643121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:36.643666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:36.649734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:36.650173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:36.650922 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:36.651353 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:36.782091 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:36.789398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-aed614b4-8995-44ee-898d-5d82b0600ae3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1322 microversion: 2.1 time: 0.150163 May 18 14:56:36.789960 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 72/139] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:36 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:37.806399 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:37.807014 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:37.809490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=58 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:37.814888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:37.815335 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:37.816092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:37.816523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:37.943435 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:37.951058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fd148be8-c13d-44ae-b9a2-a0612b98406d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1516 microversion: 2.1 time: 0.148490 May 18 14:56:37.951617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 68/140] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:37 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:37.970393 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:37.971358 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:37.973356 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=72 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:37.979385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:37.979837 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:37.980751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:37.981208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:38.145022 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lazy-loading 'flavor' on Instance uuid 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:56:38.255538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:38.265711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1e7b5c84-d049-4cf3-bcab-14001fc42808 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17/action" status: 200 len: 32 microversion: 2.1 time: 0.300395 May 18 14:56:38.266309 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 73/141] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:56:37 2022] POST /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 14:56:38.275602 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:38.276307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:38.282209 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:38.282728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:38.283591 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:38.284089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:38.585989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:38.593287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-43187879-0f35-4327-a565-67c37c6795ca tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.322273 May 18 14:56:38.593844 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 69/142] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:38 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:39.610620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:39.611625 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:39.619899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:39.620340 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:39.621142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:39.621571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:39.752151 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:39.759540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f7a00d28-547e-436f-a393-cb4c49c47e8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.153143 May 18 14:56:39.760113 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 74/143] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:39 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:40.777997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:40.778601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:40.785245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:40.785686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:40.786450 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:40.786879 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:41.107219 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:41.116516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e3041894-5bbb-4d0f-a2bb-92f6b7b29c60 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.341823 May 18 14:56:41.117367 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 70/144] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:40 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:42.134036 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:42.134674 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:42.140722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:42.141551 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:42.142310 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:42.142738 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:42.290221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:42.297865 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-60408ff8-304c-4854-98b0-b6cceed977b1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.168134 May 18 14:56:42.298437 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 75/145] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:42 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:43.316179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:43.316810 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:43.326247 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:43.326694 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:43.327468 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:43.327903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:43.583126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:43.592649 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f34ff3b7-09f6-4b9a-b595-85882823f880 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.280689 May 18 14:56:43.594097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 71/146] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:43 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:44.611836 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:44.612617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:44.622244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:44.622961 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:44.623953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:44.624464 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:44.805909 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:44.816779 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f391bf27-19ec-4e26-86b2-8210a0f81293 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.209403 May 18 14:56:44.817394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 76/147] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:44 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:45.833764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:45.834475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:45.841076 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:45.841622 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:45.842634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:45.843142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:45.988763 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:45.991176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:45.998686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c495fed4-4810-4b63-8a0c-82bd30f1b6e3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.168777 May 18 14:56:45.999296 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 72/148] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:45 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:47.018688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:47.018688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:47.023808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:47.024306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:47.025188 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:47.025802 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:47.167534 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:47.176617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-eb46bd4f-f3cb-4b8d-9391-34cb190ae05c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.163883 May 18 14:56:47.177191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 77/149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:47 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:48.202681 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:48.204112 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:48.211775 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:48.212249 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:48.213060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:48.213714 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:48.364673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:48.376886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0b01c170-b880-4de2-983d-c29100c9e57c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.184570 May 18 14:56:48.386756 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 73/150] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:48 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:49.393692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:49.394289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:49.401694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:49.402164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:49.403141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:49.403734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:49.558316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:49.567136 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9d74d958-75c9-4387-8228-fdadf69d0686 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.177199 May 18 14:56:49.568090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 78/151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:49 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:50.159828 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:50.160360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:50.168561 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:50.169074 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:50.169894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:50.170333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:50.350079 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 14:56:50.451976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d0acdaf8-896e-4538-ac54-1e72ef0b5d53 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "DELETE /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 204 len: 0 microversion: 2.1 time: 0.296118 May 18 14:56:50.452689 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 74/152] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 14:56:50 2022] DELETE /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 14:56:50.462191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:50.463156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:50.470876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:50.471581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:50.477921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:50.478395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:50.586901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:50.587834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:50.596320 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:50.596968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:50.598138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:50.598722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:50.643508 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:50.653707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d1be1256-d37a-465c-ae96-60262afe78c7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1554 microversion: 2.1 time: 0.196678 May 18 14:56:50.655590 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 79/153] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:50 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:50.759853 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:50.770410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-164a8b32-cfb0-4bb4-a950-64d7836f6bc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.188724 May 18 14:56:50.771021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 75/154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:50 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:51.671419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:51.672107 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:51.679061 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:51.679507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:51.680452 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:51.680912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:51.790339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:51.791716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:51.800968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:51.801767 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:51.802704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:51.803375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:51.841724 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:51.852773 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f01cec96-bb47-4625-85d3-be75cce555db tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1554 microversion: 2.1 time: 0.184451 May 18 14:56:51.854044 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 80/155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:51 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:52.004011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:52.018461 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d6380c69-32d3-4032-a748-d1f5211c432d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.233356 May 18 14:56:52.019039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 76/156] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:51 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:52.870177 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:52.870936 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:52.877734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:52.878318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:52.879461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:52.880095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:53.039472 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:53.040779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:53.049280 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:53.051197 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:53.052895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:53.054518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:53.071963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:53.087349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-57ff4507-dcbf-4ea0-bc1b-a485a8d40464 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1554 microversion: 2.1 time: 0.220830 May 18 14:56:53.088412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 81/157] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:52 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:53.349774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:53.367445 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d349cce8-ef24-4161-b3c3-d3b2711eda36 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.333296 May 18 14:56:53.368812 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 77/158] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:53 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:54.105943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:54.107216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:54.128804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:54.129396 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:54.130559 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:54.131884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:54.215365 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-ac7b59a5-b86b-4a7c-b929-110113fdd5ef req-41df5237-6965-41ba-8897-997fb0d5a934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211fbe03-a0bd-49d9-a86f-3a4147d3a696", "name": "network-vif-deleted", "tag": "aa22c1c3-af67-444a-95d8-fc498125658c"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:54.243166 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-ac7b59a5-b86b-4a7c-b929-110113fdd5ef req-41df5237-6965-41ba-8897-997fb0d5a934 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:54.244673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-ac7b59a5-b86b-4a7c-b929-110113fdd5ef req-41df5237-6965-41ba-8897-997fb0d5a934 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:54.264075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:54.277661 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-37d37c1b-6326-44c8-b801-ea20b592099c tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1512 microversion: 2.1 time: 0.175622 May 18 14:56:54.279122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 82/159] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:54 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:54.290638 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-ac7b59a5-b86b-4a7c-b929-110113fdd5ef req-41df5237-6965-41ba-8897-997fb0d5a934 service nova] Creating event network-vif-deleted:aa22c1c3-af67-444a-95d8-fc498125658c for instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 on hv-cinder-83998 May 18 14:56:54.298801 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-ac7b59a5-b86b-4a7c-b929-110113fdd5ef req-41df5237-6965-41ba-8897-997fb0d5a934 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089367 May 18 14:56:54.300296 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 78/160] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:56:54.388540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:54.389380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:54.400766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:54.401885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:54.403060 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:54.404055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:54.584368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:54.595879 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3225b609-ff7b-4513-8cd2-5d87d535993a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.215100 May 18 14:56:54.596466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 83/161] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:54 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:55.295509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:55.296211 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:55.304542 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:55.305384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:55.306537 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:55.306908 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:55.384404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:55.395600 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1b14c8ab-8c4d-42a2-af4c-2f61f7aa1f91 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1345 microversion: 2.1 time: 0.104546 May 18 14:56:55.397340 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 79/162] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:55 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:55.613251 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:55.613937 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:55.620652 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:55.621169 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:55.622039 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:55.622449 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:55.769344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:55.779263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-489251b0-3018-4595-83fc-e029a68b9dff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.169566 May 18 14:56:55.789035 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 84/163] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:55 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:56.413690 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:56.414268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:56.420888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:56.421326 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:56.422121 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:56.422564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:56.493322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:56.502469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-91ca487a-7e3f-4f0f-8f57-ef2d78bb0b56 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1345 microversion: 2.1 time: 0.093401 May 18 14:56:56.509222 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 80/164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:56 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:56.796128 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:56.796772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:56.802941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:56.803411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:56.804156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:56.804608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:56.931561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:56.938966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-22b63f02-ef46-45b1-86b6-5db674d07079 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.146638 May 18 14:56:56.939530 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 85/165] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:56 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:57.519331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:57.519891 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:57.526319 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:57.526756 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:57.527568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:57.527993 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:57.590542 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:57.598474 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-30ccbeb1-b9eb-4902-a0ea-91ea2ff9bd8e tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1345 microversion: 2.1 time: 0.083041 May 18 14:56:57.599028 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 81/166] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:57 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:57.960066 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:57.960714 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:57.966669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:57.967120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:57.967876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:57.968306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:58.104993 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:58.112549 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-fc674c54-b5a2-45a2-88a7-e6d9b223c02b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.156894 May 18 14:56:58.113134 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 86/167] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:57 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:58.616231 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:58.617639 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:58.624960 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:58.625488 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:58.626299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:58.626784 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:58.666676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:58.667134 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:58.667598 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lazy-loading 'fault' on Instance uuid 211fbe03-a0bd-49d9-a86f-3a4147d3a696 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:56:58.716466 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4769e15ff54700be019d0b0dee5f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8861f7058f96459fa715dddf23cc3908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:58.727035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c873268e-b0cd-41bb-9b57-6bb4de6545b8 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 200 len: 1350 microversion: 2.1 time: 0.115489 May 18 14:56:58.727642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 82/168] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:58 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:56:58.765921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-825570720", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:56:58.817600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] validate_networks() for None {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:56:59.102050 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:56:59.102781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:56:59.102954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:56:59.105867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:56:59.106327 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:56:59.116724 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.117166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.117950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.118441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.131016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:59.132266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:59.136837 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Getting quotas for project daae77ba94fc4aa7b632002da6304ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:56:59.138486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.138966 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.139946 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.140567 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.141234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Getting quotas for user 171a776a46b74b78aeded3ceee42647a and project daae77ba94fc4aa7b632002da6304ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:56:59.155117 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:56:59.158391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:56:59.206855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0087b329-71df-4f6b-8bb5-b175228a821a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.445229 May 18 14:56:59.208174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 87/169] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 14:56:59.217726 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f031dda9-b064-454e-ac71-4fedde7d0bd3 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:59.225953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f031dda9-b064-454e-ac71-4fedde7d0bd3 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:59.309125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f031dda9-b064-454e-ac71-4fedde7d0bd3 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:59.322077 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f031dda9-b064-454e-ac71-4fedde7d0bd3 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1214 microversion: 2.1 time: 0.107970 May 18 14:56:59.322654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 88/170] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:59 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:59.344478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:56:59.362344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-971ee608-188a-41e5-8381-5c94e68e8804 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.236390 May 18 14:56:59.364455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 83/171] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:59 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:56:59.744966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:59.745590 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:59.753399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.753849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.754696 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.755775 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.770969 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] HTTP exception thrown: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Request method failure captured: May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 HTTP/1.1 May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjoy7tjVtiOGKpSSRnreV1BaGnBxmhFEuaDNd0x-aNYcI1-VigZG_H-Rv95fapKJ1YG2ZKrHLbLoVXQorhqOAtRyo9Mtg0HsBKGPP79SDsf6GYs3MXT0GLpy7m5cltHTi-Wz-fgyC0qbp0TJPUY8Ez9LP3CMhHxlz1Z9evaXwlT0fM May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:56:59.779858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8861f7058f96459fa715dddf23cc3908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-DeleteServersTestJSON-1978537105 May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-DeleteServersTestJSON-1978537105-project May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 4e4769e15ff54700be019d0b0dee5f64 May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-DeleteServersTestJSON-1978537105-project May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.781190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '211fbe03-a0bd-49d9-a86f-3a4147d3a696'} May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:56:59.781838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.783925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:56:59.785397 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Returning 404 to user: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:56:59.785397 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0becbec0-ddcf-4d9b-ad6a-066528e1d2a7 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 404 len: 111 microversion: 2.1 time: 0.041862 May 18 14:56:59.785397 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 89/172] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:56:59 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:56:59.892946 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:56:59.893891 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:56:59.900963 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.902131 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.902947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:56:59.903389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:56:59.916861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] HTTP exception thrown: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Request method failure captured: May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696/os-volume_attachments HTTP/1.1 May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjoy7tjVtiOGKpSSRnreV1BaGnBxmhFEuaDNd0x-aNYcI1-VigZG_H-Rv95fapKJ1YG2ZKrHLbLoVXQorhqOAtRyo9Mtg0HsBKGPP79SDsf6GYs3MXT0GLpy7m5cltHTi-Wz-fgyC0qbp0TJPUY8Ez9LP3CMhHxlz1Z9evaXwlT0fM May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:56:59.921410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8861f7058f96459fa715dddf23cc3908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-DeleteServersTestJSON-1978537105 May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-DeleteServersTestJSON-1978537105-project May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 4e4769e15ff54700be019d0b0dee5f64 May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-DeleteServersTestJSON-1978537105-project May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.922562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'server_id': '211fbe03-a0bd-49d9-a86f-3a4147d3a696'} May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:56:59.923207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:56:59.924258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:56:59.926645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Returning 404 to user: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:56:59.926645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d4d44082-610f-4571-9ed4-e58e48d47959 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034034 May 18 14:56:59.926645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 84/173] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 14:56:59 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 14:57:00.339594 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:00.340201 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:00.346372 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:00.346805 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:00.347613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:00.348047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:00.380558 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:00.381698 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:00.387903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:00.388609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:00.389436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:00.389869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:00.411047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:00.419426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-41871071-6299-4382-864d-08438ad98e5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1210 microversion: 2.1 time: 0.083582 May 18 14:57:00.420245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 90/174] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:00 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:00.537806 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:00.545295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cabd24c8-2fb9-4cca-800a-91ccb2a6b45a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.168759 May 18 14:57:00.545845 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 85/175] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:00 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:01.440830 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:01.441503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:01.447888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:01.448380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:01.449213 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:01.449647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:01.511950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:01.520499 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ce2224a5-9661-4840-a0aa-4de2aa06d0b8 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1210 microversion: 2.1 time: 0.083593 May 18 14:57:01.521370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 91/176] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:01 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:01.564064 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:01.564797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:01.573059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:01.573511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:01.574290 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:01.576883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:01.705870 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:01.714174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-aecf8d53-b627-4187-9c4a-74a25d130be9 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.156293 May 18 14:57:01.714756 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 86/177] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:01 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:02.538780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:02.539670 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:02.547303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:02.547753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:02.548538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:02.551231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:02.630526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:02.635321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:02.640986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e340f77a-45e1-43d5-b185-2afbce82a146 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1266 microversion: 2.1 time: 0.107055 May 18 14:57:02.644773 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 92/178] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:02 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:02.730803 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:02.731416 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:02.737894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:02.738333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:02.739081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:02.739508 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:02.867999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:02.875408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-20bd8d58-475b-469d-b54a-25f479476ba1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.148386 May 18 14:57:02.876021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 87/179] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:02 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:03.237304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:03.237885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:03.245538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.245983 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.246761 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.247230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.261415 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] HTTP exception thrown: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Request method failure captured: May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 HTTP/1.1 May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjoy7tjVtiOGKpSSRnreV1BaGnBxmhFEuaDNd0x-aNYcI1-VigZG_H-Rv95fapKJ1YG2ZKrHLbLoVXQorhqOAtRyo9Mtg0HsBKGPP79SDsf6GYs3MXT0GLpy7m5cltHTi-Wz-fgyC0qbp0TJPUY8Ez9LP3CMhHxlz1Z9evaXwlT0fM May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:57:03.262971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8861f7058f96459fa715dddf23cc3908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-DeleteServersTestJSON-1978537105 May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-DeleteServersTestJSON-1978537105-project May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 4e4769e15ff54700be019d0b0dee5f64 May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-DeleteServersTestJSON-1978537105-project May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.264392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '211fbe03-a0bd-49d9-a86f-3a4147d3a696'} May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:57:03.265193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.266304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:03.267433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Returning 404 to user: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:57:03.267433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-74a217d4-0ca4-4f80-8265-8075d64eac95 tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "DELETE /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 404 len: 111 microversion: 2.1 time: 0.031243 May 18 14:57:03.267433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 93/180] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 14:57:03 2022] DELETE /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:57:03.273857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:03.274868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] [instance: 211fbe03-a0bd-49d9-a86f-3a4147d3a696] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:03.282553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.282994 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.283994 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.284827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.304799 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] HTTP exception thrown: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Request method failure captured: May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 HTTP/1.1 May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjoy7tjVtiOGKpSSRnreV1BaGnBxmhFEuaDNd0x-aNYcI1-VigZG_H-Rv95fapKJ1YG2ZKrHLbLoVXQorhqOAtRyo9Mtg0HsBKGPP79SDsf6GYs3MXT0GLpy7m5cltHTi-Wz-fgyC0qbp0TJPUY8Ez9LP3CMhHxlz1Z9evaXwlT0fM May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:57:03.307029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8861f7058f96459fa715dddf23cc3908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8861f7058f96459fa715dddf23cc3908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-DeleteServersTestJSON-1978537105 May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 8861f7058f96459fa715dddf23cc3908 May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1978537105 May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-DeleteServersTestJSON-1978537105-project May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 4e4769e15ff54700be019d0b0dee5f64 May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-DeleteServersTestJSON-1978537105-project May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.308245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '211fbe03-a0bd-49d9-a86f-3a4147d3a696'} May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:57:03.309078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. May 18 14:57:03.310160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:03.311118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] Returning 404 to user: Instance 211fbe03-a0bd-49d9-a86f-3a4147d3a696 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:57:03.311118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c68cca31-450b-40e7-8ed4-69300edcafca tempest-DeleteServersTestJSON-1978537105 tempest-DeleteServersTestJSON-1978537105-project] 10.222.0.59 "GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696" status: 404 len: 111 microversion: 2.1 time: 0.039052 May 18 14:57:03.311118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 88/181] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:03 2022] GET /compute/v2.1/servers/211fbe03-a0bd-49d9-a86f-3a4147d3a696 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:57:03.658488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:03.659107 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:03.676601 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.677253 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.678299 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.679376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.796443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:03.809744 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-36c21146-db9e-4212-aaeb-f48b0f47db5d tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1272 microversion: 2.1 time: 0.155283 May 18 14:57:03.819950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 94/182] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:03 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:03.900022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:03.900868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:03.914675 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.917383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.919900 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:03.920443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:03.941715 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:04.452866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:04.462589 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a8317034-69fa-421e-9b76-de8b891274ec tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.567117 May 18 14:57:04.463258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 89/183] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:03 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:04.845261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:04.846694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:04.853176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:04.854142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:04.855192 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:04.855841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:05.197109 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:05.207338 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5560b0ef-c5cd-4dee-aa30-76657c4c4955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.375193 May 18 14:57:05.208438 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 95/184] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:04 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:05.480681 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:05.481909 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:05.489719 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:05.490904 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:05.492360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:05.493107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:05.773183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:05.782560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cc121062-b2a2-4592-9481-d2709cc86936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.306082 May 18 14:57:05.783245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 90/185] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:05 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:05.935548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-2dfd3cfb-764a-4f03-af32-c254d8644aa6 req-08758c66-d0de-4a97-9086-f37c6e6b8d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34fecf88-13a5-40b7-9177-c0b6319cf78b", "tag": "1c02c86c-6848-4f9b-9999-6050fc55be61"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:05.962816 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2dfd3cfb-764a-4f03-af32-c254d8644aa6 req-08758c66-d0de-4a97-9086-f37c6e6b8d6e service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:05.963388 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2dfd3cfb-764a-4f03-af32-c254d8644aa6 req-08758c66-d0de-4a97-9086-f37c6e6b8d6e service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:05.986563 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-2dfd3cfb-764a-4f03-af32-c254d8644aa6 req-08758c66-d0de-4a97-9086-f37c6e6b8d6e service nova] Creating event network-changed:1c02c86c-6848-4f9b-9999-6050fc55be61 for instance 34fecf88-13a5-40b7-9177-c0b6319cf78b on hv-cinder-83998 May 18 14:57:05.992432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-2dfd3cfb-764a-4f03-af32-c254d8644aa6 req-08758c66-d0de-4a97-9086-f37c6e6b8d6e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062003 May 18 14:57:05.993275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 96/186] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:06.229808 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:06.232127 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:06.246177 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:06.247000 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:06.259097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:06.259886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:06.487935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:06.505735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-97e9e777-0a55-407b-9541-66bf24994bcd tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.284111 May 18 14:57:06.507294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 91/187] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:06 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:06.803514 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:06.804837 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:06.811174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:06.812064 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:06.813315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:06.814450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:07.098045 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:07.108288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4b7e315a-4f93-4516-8f38-47cc71be177b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.309763 May 18 14:57:07.121351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 97/188] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:06 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:07.524407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:07.526587 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:07.536092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:07.539124 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:07.540241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:07.541707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:07.842968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:07.858679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-52ac4e15-c099-495b-b405-cccc9a60b955 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.337678 May 18 14:57:07.861544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 92/189] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:07 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:08.127492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:08.128933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:08.136143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:08.139015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:08.139460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:08.140404 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:08.140898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:08.422125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:08.433369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9a90dd15-95e4-49a9-a396-599b5253d121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.311677 May 18 14:57:08.434703 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 98/190] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:08 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:08.888273 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:08.890475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:08.906067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:08.919996 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:08.921631 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:08.923528 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:08.924773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:09.133463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:09.157728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-48f6f459-1a99-4476-ad48-4b44de91c65f tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.282478 May 18 14:57:09.165953 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 93/191] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:08 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:09.456088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:09.457369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:09.464551 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:09.466364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=8 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:09.468841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:09.469755 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:09.470802 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:09.471490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:09.680723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:09.695626 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5ed0e7d8-1b8f-435c-8909-446c56475998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.248049 May 18 14:57:09.697797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 99/192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:09 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:10.185111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:10.186126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:10.198365 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:10.202284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:10.203300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:10.203825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:10.496885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-74824439-713e-4abf-8f19-7855b5238b95 req-92d5265e-b4f3-4825-a64d-630ff530d770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34fecf88-13a5-40b7-9177-c0b6319cf78b", "name": "network-vif-plugged", "status": "completed", "tag": "1c02c86c-6848-4f9b-9999-6050fc55be61"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:10.500264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:10.510897 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a9c03257-9478-4db8-963d-36fee0d33e07 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.329954 May 18 14:57:10.511688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 94/193] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:10 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:10.519930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-74824439-713e-4abf-8f19-7855b5238b95 req-92d5265e-b4f3-4825-a64d-630ff530d770 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:10.521969 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-74824439-713e-4abf-8f19-7855b5238b95 req-92d5265e-b4f3-4825-a64d-630ff530d770 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:10.556744 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-74824439-713e-4abf-8f19-7855b5238b95 req-92d5265e-b4f3-4825-a64d-630ff530d770 service nova] Creating event network-vif-plugged:1c02c86c-6848-4f9b-9999-6050fc55be61 for instance 34fecf88-13a5-40b7-9177-c0b6319cf78b on hv-cinder-83998 May 18 14:57:10.572037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-74824439-713e-4abf-8f19-7855b5238b95 req-92d5265e-b4f3-4825-a64d-630ff530d770 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084265 May 18 14:57:10.574234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 100/194] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:10.714455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:10.715081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:10.727195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:10.736484 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:10.737455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:10.737907 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:11.156053 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:11.168945 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ead8005e-b8ed-46ed-a32f-5bc9488f1166 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.458209 May 18 14:57:11.169861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 95/195] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:10 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:11.529845 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:11.531405 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:11.550596 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:11.554361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:11.557808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:11.558889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:11.798272 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:11.812433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d9858d35-efeb-433b-bf4f-f7f05ce9c233 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.288002 May 18 14:57:11.814830 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 101/196] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:11 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:12.186996 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:12.187867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:12.195453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:12.196008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:12.196891 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:12.197401 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:12.401174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:12.418121 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a1694d81-8497-4322-86a9-a1bf1a2f90ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.234865 May 18 14:57:12.418581 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 96/197] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:12 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:12.829950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:12.830566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:12.836996 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:12.837450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:12.839556 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:12.840013 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:13.067103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:13.076695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3f60b375-6aac-46de-b050-3a074909a810 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1314 microversion: 2.1 time: 0.250401 May 18 14:57:13.078994 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 102/198] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:12 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:13.149747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f7877406-a3f9-462e-ab59-0ac37586566a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: .version_select at 0x7fa8a1631820>, body: {"keypair": {"name": "tempest-keypair-1203252478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdr2NJsfV+Q3IEZVKaOkjmXiQSdIokjE/I6wpbt7G7hfc1vKMg5+4W5qyYweJ8br5YROLHlqDMLq/C1qsDZeiguChHf12wYNERn+MfScVhpymXwjTMdR6m0kEwtyNyQyA=="}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:13.179373 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-f7877406-a3f9-462e-ab59-0ac37586566a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:13.183839 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-f7877406-a3f9-462e-ab59-0ac37586566a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for user 88c71f6ddf364c9baca69e459547ab02 and project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:13.263113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f7877406-a3f9-462e-ab59-0ac37586566a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.318896 May 18 14:57:13.265064 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 97/199] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 14:57:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:13.437099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:13.437099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:13.449575 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:13.450403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:13.451332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:13.451835 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:13.823570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:13.832722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7d50c9e7-7e5b-4043-9e95-ec5e5e5ef936 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.401654 May 18 14:57:13.835141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 103/200] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:13 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:14.095260 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:14.096164 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:14.104804 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.105508 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.106496 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.107126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.333624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:14.356166 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e91597d3-0759-42a9-b125-a2c244dc25f6 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1463 microversion: 2.1 time: 0.263769 May 18 14:57:14.357099 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 98/201] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:14 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:14.439809 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:14.440729 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:14.457131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.460860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.465608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.467698 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.513408 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 14:57:14.671516 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-27f65940-ca30-4324-ae21-6ac103032582 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "DELETE /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 204 len: 0 microversion: 2.1 time: 0.241868 May 18 14:57:14.672287 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 104/202] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 14:57:14 2022] DELETE /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 14:57:14.680769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:14.681397 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:14.689167 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.689617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.690407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.690837 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.853608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:14.854348 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:14.864294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.864783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:14.867000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:14.867446 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:15.173693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:15.186810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c934ad97-a14e-4cb6-a5da-9058efe01900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.338498 May 18 14:57:15.199463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 105/203] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:14 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:15.287813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:15.320359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2efcfeda-2c5d-4900-84ec-ba00e559eb7a tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1469 microversion: 2.1 time: 0.643545 May 18 14:57:15.321337 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 99/204] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:14 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1469 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:16.206084 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:16.207223 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:16.224222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:16.227275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:16.228047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:16.228490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:16.350442 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:16.351123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:16.368684 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:16.371365 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:16.374795 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:16.375434 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:16.563745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:16.580916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8a3fecc0-b4ee-4b95-9b25-b03328719888 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.379562 May 18 14:57:16.592934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 106/205] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:16 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:16.603462 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1340367307", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6d46917-2e57-430f-9dbe-54ed4755b607"}], "security_groups": [{"name": "tempest-securitygroup--247484718"}], "key_name": "tempest-keypair-1203252478", "user_data": "}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:16.682895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:16.698511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-33375ef1-3ded-4fe1-864b-f12f1de1a1ab tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1469 microversion: 2.1 time: 0.350970 May 18 14:57:16.699351 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 100/206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:16 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:16.892375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] validate_networks() for [('f6d46917-2e57-430f-9dbe-54ed4755b607', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:57:17.598719 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:17.600075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:17.607219 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:17.607676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:17.608616 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:17.609227 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:17.740098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:57:17.741096 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:57:17.741805 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:57:17.742225 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:57:17.742640 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:57:17.752240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:17.752945 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:17.753747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:17.757085 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:17.776076 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:17.780917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for user 88c71f6ddf364c9baca69e459547ab02 and project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:17.798809 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:57:17.801972 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:57:17.870745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b0bacaa4-6fd4-4411-b45e-76c835d07e85 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.272773 May 18 14:57:17.872386 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 107/207] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:57:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:57:17.877627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:17.878407 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:17.879354 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:17.887860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:17.888542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:17.891095 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4de7dd89-3e1d-486e-9ecb-02419d8f9af4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.295639 May 18 14:57:17.892301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:17.893062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 101/208] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:17 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:17.893198 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:17.898344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f21183c8-3222-402d-a6bf-ecc96ab4a145 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:17.899340 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f21183c8-3222-402d-a6bf-ecc96ab4a145 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:18.048869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:18.060349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c9b29385-6379-45ba-b9ba-943d032e5f28 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1427 microversion: 2.1 time: 0.186702 May 18 14:57:18.062655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 108/209] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:17 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1427 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:18.111784 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f21183c8-3222-402d-a6bf-ecc96ab4a145 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:18.127401 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f21183c8-3222-402d-a6bf-ecc96ab4a145 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1238 microversion: 2.1 time: 0.232777 May 18 14:57:18.128042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 102/210] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:17 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1238 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:18.189043 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-362b37b4-bca0-4862-8e76-eba7022d71c1 req-a548d666-e1e9-495a-96b9-2da325f0e4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34fecf88-13a5-40b7-9177-c0b6319cf78b", "name": "network-vif-deleted", "tag": "1c02c86c-6848-4f9b-9999-6050fc55be61"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:18.201296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-362b37b4-bca0-4862-8e76-eba7022d71c1 req-a548d666-e1e9-495a-96b9-2da325f0e4c5 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:18.201788 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-362b37b4-bca0-4862-8e76-eba7022d71c1 req-a548d666-e1e9-495a-96b9-2da325f0e4c5 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:18.230269 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-362b37b4-bca0-4862-8e76-eba7022d71c1 req-a548d666-e1e9-495a-96b9-2da325f0e4c5 service nova] Creating event network-vif-deleted:1c02c86c-6848-4f9b-9999-6050fc55be61 for instance 34fecf88-13a5-40b7-9177-c0b6319cf78b on hv-cinder-83998 May 18 14:57:18.245350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-362b37b4-bca0-4862-8e76-eba7022d71c1 req-a548d666-e1e9-495a-96b9-2da325f0e4c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064435 May 18 14:57:18.246165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 109/211] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:18.908957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:18.909607 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:18.916873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:18.917326 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:18.918085 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:18.918518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:19.060211 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:19.068046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-85dcddb3-f1a0-4c3a-91f8-de5090528fc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.162907 May 18 14:57:19.078114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 103/212] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:18 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:19.083479 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:19.084230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:19.091389 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:19.091848 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:19.092658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:19.093099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:19.145740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:19.146632 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:19.152849 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:19.153474 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:19.154252 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:19.154689 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:19.158094 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:19.167273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6b010911-eb62-4f7d-ac74-ee34d411ad69 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1427 microversion: 2.1 time: 0.087878 May 18 14:57:19.168239 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 110/213] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:19 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:19.218307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:19.226465 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-77fee3c0-1f35-414d-a012-820ada59c49c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1242 microversion: 2.1 time: 0.084498 May 18 14:57:19.227035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 104/214] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:19 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:20.087105 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:20.087717 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:20.093699 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.094158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.094925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.095364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.099840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:20.186688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:20.187315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:20.199376 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.199828 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.200625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.201062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.234538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.234981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.235427 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lazy-loading 'fault' on Instance uuid 34fecf88-13a5-40b7-9177-c0b6319cf78b {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:57:20.264543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:20.272832 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7b7792aa-0b5f-45c6-86fa-d552c589a11b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1522 microversion: 2.1 time: 0.191302 May 18 14:57:20.273472 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 111/215] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:20 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:20.277810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:20.280902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171a776a46b74b78aeded3ceee42647a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daae77ba94fc4aa7b632002da6304ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:20.284536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:20.289053 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a4622128-2ed1-4d05-9d20-b2e6bd93c0af tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 200 len: 1304 microversion: 2.1 time: 0.106353 May 18 14:57:20.289622 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 105/216] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:20 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:20.291038 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.291492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.292263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:20.292792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:20.357604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:20.365042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c534dbc4-3d89-43e2-a875-5b15147f5058 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1242 microversion: 2.1 time: 0.090667 May 18 14:57:20.365615 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 112/217] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:20 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:21.289892 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:21.292020 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:21.298505 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.298957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.299920 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.300455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.308480 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:21.309263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] [instance: 34fecf88-13a5-40b7-9177-c0b6319cf78b] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:21.316845 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.317307 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.319222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.319867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.338121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] HTTP exception thrown: Instance 34fecf88-13a5-40b7-9177-c0b6319cf78b could not be found. May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Request method failure captured: May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b HTTP/1.1 May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQk2g4QftwpDR32YGxjFLYJVJkUnGbwWkG1aqSIQdKmwFx9q0WwH-aCpffWEEv9hSXG7jAb_Yd8HheLJ-wX6yYg_-V3RPCNpvFQvgdcOhz_aG3U3xChsIUpM19_p5YhNIOnA1SPdv34RAP_TuFBK_RIlSVgb6B1rzRRYCjXTqPK0Lyk May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: daae77ba94fc4aa7b632002da6304ceb May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-VolumesNegativeTest-241901163 May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:57:21.339808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/daae77ba94fc4aa7b632002da6304ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/daae77ba94fc4aa7b632002da6304ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/daae77ba94fc4aa7b632002da6304ceb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_daae77ba94fc4aa7b632002da6304ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-VolumesNegativeTest-241901163 May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: daae77ba94fc4aa7b632002da6304ceb May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-VolumesNegativeTest-241901163 May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-VolumesNegativeTest-241901163-project May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 171a776a46b74b78aeded3ceee42647a May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-VolumesNegativeTest-241901163-project May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 34fecf88-13a5-40b7-9177-c0b6319cf78b could not be found. May 18 14:57:21.341490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '34fecf88-13a5-40b7-9177-c0b6319cf78b'} May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34fecf88-13a5-40b7-9177-c0b6319cf78b could not be found. May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:57:21.342357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34fecf88-13a5-40b7-9177-c0b6319cf78b could not be found. May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34fecf88-13a5-40b7-9177-c0b6319cf78b could not be found. May 18 14:57:21.343764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:21.345139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] Returning 404 to user: Instance 34fecf88-13a5-40b7-9177-c0b6319cf78b could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:57:21.350071 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-25626476-98b6-43db-a99d-b25f0f8ab351 tempest-VolumesNegativeTest-241901163 tempest-VolumesNegativeTest-241901163-project] 10.222.0.59 "GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b" status: 404 len: 111 microversion: 2.1 time: 0.045812 May 18 14:57:21.351035 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 113/218] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:21 2022] GET /compute/v2.1/servers/34fecf88-13a5-40b7-9177-c0b6319cf78b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:57:21.381957 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:21.382574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:21.394613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.395326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.396399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.397260 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.476781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:21.481932 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:21.485029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6e48d15b-52b1-4e56-9eba-63e085e216b5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1290 microversion: 2.1 time: 0.106670 May 18 14:57:21.493561 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-948b4aa0-cb8e-4cd8-bd9d-83330474d4cf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1502 microversion: 2.1 time: 0.207417 May 18 14:57:21.494618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 106/219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:21 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:21.500181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 114/220] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:21 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:21.511606 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:21.512826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:21.520200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.520780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.521682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:21.522347 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:21.690825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:21.700807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0b15a305-d8cc-476f-9b9b-0d6b11b9eb9e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1515 microversion: 2.1 time: 0.193396 May 18 14:57:21.708761 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 115/221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:21 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:22.507950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:22.510528 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:22.520481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:22.521125 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:22.521971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:22.522558 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:22.603949 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:22.611263 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=100 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:22.614787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b0d5c14a-db93-4055-b26c-123f775eb8bd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1296 microversion: 2.1 time: 0.115149 May 18 14:57:22.616605 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 107/222] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:22 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:23.210707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:23.212295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:23.219976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:23.221792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:23.221792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:23.221948 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:23.253332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lazy-loading 'flavor' on Instance uuid 447f7721-8ce1-4cbe-996a-75b2426474bc {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:57:23.344878 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ccabf3c2-271d-4e87-ad3d-f71129aeb268 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/action" status: 200 len: 32 microversion: 2.1 time: 0.138642 May 18 14:57:23.345792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 116/223] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:57:23 2022] POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 14:57:23.358360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:23.360020 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:23.377877 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:23.379728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:23.381279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:23.382651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:23.637844 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:23.638560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:23.649536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:23.650012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:23.650934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:23.651382 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:23.787041 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:23.799830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3211208d-65c7-4513-a9cc-31e5f373b6c6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.446996 May 18 14:57:23.812742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 108/224] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:23 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:24.026329 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:24.040172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2538a4b7-bfe0-413c-aced-514c84ca3e7e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.410403 May 18 14:57:24.044874 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 117/225] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:23 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:24.608551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-f2bfa2b0-8d73-405e-a54d-482265570916 req-9a67f380-cb1d-435d-8107-6f5774f7227c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7efce9-bda4-4d05-a813-164f962babab", "tag": "8c977413-3f2a-4a40-84bc-101572b4ab37"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:24.620886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-f2bfa2b0-8d73-405e-a54d-482265570916 req-9a67f380-cb1d-435d-8107-6f5774f7227c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:24.621331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-f2bfa2b0-8d73-405e-a54d-482265570916 req-9a67f380-cb1d-435d-8107-6f5774f7227c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:24.644971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-f2bfa2b0-8d73-405e-a54d-482265570916 req-9a67f380-cb1d-435d-8107-6f5774f7227c service nova] Creating event network-changed:8c977413-3f2a-4a40-84bc-101572b4ab37 for instance ee7efce9-bda4-4d05-a813-164f962babab on hv-cinder-83998 May 18 14:57:24.654469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-f2bfa2b0-8d73-405e-a54d-482265570916 req-9a67f380-cb1d-435d-8107-6f5774f7227c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052887 May 18 14:57:24.655143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 109/226] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:24.818931 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:24.819559 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:24.825991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:24.826441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:24.827211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:24.827913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:25.073309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:25.074750 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:25.082625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:25.083452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:25.084842 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:25.085469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:25.097924 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:25.107156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9fdf6e50-7d9e-4a22-8fe4-21d9d4ffb1b7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.292708 May 18 14:57:25.107736 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 118/227] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:24 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:25.292774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:25.304764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7e3cc6d4-8a3f-4ddd-8433-f9f0521696ad tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.249617 May 18 14:57:25.308283 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 110/228] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:25 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:26.127191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:26.127889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:26.136722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:26.137307 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:26.138314 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:26.138756 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:26.295561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:26.304824 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-aadc999e-d0fd-48c3-a0c1-cb43b5da160e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.183364 May 18 14:57:26.305403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 119/229] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:26 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:26.324417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:26.325766 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:26.331822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:26.332277 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:26.334588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:26.334588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:26.633533 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:26.644822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a36ef47d-ea84-4c5e-b84c-4020f14bf1cf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.323446 May 18 14:57:26.645625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 111/230] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:26 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:27.322412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:27.323031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:27.329994 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:27.330440 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:27.331400 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:27.331833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:27.477570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:27.487900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-29d022e9-0161-4a28-9df8-1481c14f333a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.170131 May 18 14:57:27.490052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 120/231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:27 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:27.663357 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:27.663991 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:27.670646 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:27.671443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:27.672402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:27.673072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:27.855777 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:27.865051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8f4a6817-ea02-45bf-928e-74a11e531b58 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.205908 May 18 14:57:27.865778 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 112/232] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:27 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:28.506473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:28.507705 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:28.510045 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.510933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.519525 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:28.519983 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:28.520841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:28.521895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:28.536037 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:28.539537 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:28.550342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=6 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.555859 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:28.556682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:28.558030 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:28.559594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:28.590931 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4444822c-e10f-4dba-9ca1-f42cef75b5c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/ips" status: 200 len: 151 microversion: 2.20 time: 0.060771 May 18 14:57:28.597682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 113/233] 10.222.0.59 () {60 vars in 1288 bytes} [Wed May 18 14:57:28 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:57:28.884142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:28.885190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:28.897928 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:28.899704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:28.901331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:28.901967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:28.963254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:28.979615 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-446d51fa-0c95-4c30-9ee1-087a7db22b23 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.472579 May 18 14:57:28.980272 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 121/234] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:28 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:29.363526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:29.374777 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-96b1eccd-d970-4621-a9c9-a03fd7ce2e07 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.496768 May 18 14:57:29.375577 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 114/235] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:28 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:29.997261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:29.997946 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:30.011682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:30.012547 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:30.013525 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:30.017242 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:30.289041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:30.299317 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d779015d-a748-4a2b-8b63-f97a5adfc900 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.305767 May 18 14:57:30.299966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 122/236] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:29 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:30.391329 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:30.392478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:30.401515 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:30.402180 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:30.403152 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:30.404289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:30.719142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:30.728953 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-497a6512-0672-490f-a3b5-6e6918be0a30 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.341275 May 18 14:57:30.729661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 115/237] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:30 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:30.858119 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:30.858636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:30.866692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:30.869379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:30.870321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:30.871376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:30.939551 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lazy-loading 'flavor' on Instance uuid 5cf9b2c2-1694-4695-8c54-940340452792 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:57:31.226503 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-1642f941-0af6-432c-b6e7-ff2c60a2de45 req-fbae934a-1466-4b46-a889-a47c954b297b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7efce9-bda4-4d05-a813-164f962babab", "name": "network-vif-plugged", "status": "completed", "tag": "8c977413-3f2a-4a40-84bc-101572b4ab37"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:31.237326 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1642f941-0af6-432c-b6e7-ff2c60a2de45 req-fbae934a-1466-4b46-a889-a47c954b297b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.238343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1642f941-0af6-432c-b6e7-ff2c60a2de45 req-fbae934a-1466-4b46-a889-a47c954b297b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.257617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-1642f941-0af6-432c-b6e7-ff2c60a2de45 req-fbae934a-1466-4b46-a889-a47c954b297b service nova] Creating event network-vif-plugged:8c977413-3f2a-4a40-84bc-101572b4ab37 for instance ee7efce9-bda4-4d05-a813-164f962babab on hv-cinder-83998 May 18 14:57:31.266370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-1642f941-0af6-432c-b6e7-ff2c60a2de45 req-fbae934a-1466-4b46-a889-a47c954b297b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044146 May 18 14:57:31.267294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 116/238] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:31.319320 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:31.320888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:31.338248 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.338716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.339757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.340395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.412808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-170f86f9-33c3-4f54-81f4-a863f3e8ec54 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/action" status: 202 len: 0 microversion: 2.20 time: 0.558508 May 18 14:57:31.415581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 123/239] 10.222.0.59 () {62 vars in 1318 bytes} [Wed May 18 14:57:30 2022] POST /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 14:57:31.444931 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:31.445976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:31.453979 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.454663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.455697 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.456347 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.483248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:31.859934 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:31.872509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-58a3901d-2106-47d0-ad62-d51367a57164 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.558991 May 18 14:57:31.875968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 117/240] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:31 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:31.879856 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:31.881251 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:31.889172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.889781 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.891250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:31.891999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:31.892812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:31.904079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:31.907964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:31.909426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5af73e0d-5caa-4180-9b0f-9cc636444a3b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.477073 May 18 14:57:31.910753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 124/241] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:31 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:32.221048 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:32.232730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-498e43a1-1ccb-4093-97c7-9bbabd883099 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.357016 May 18 14:57:32.237240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 118/242] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:31 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:32.892457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:32.894245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:32.903653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:32.905256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:32.905812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:32.906460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:32.935298 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:32.936603 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:32.950776 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:32.952277 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:32.954423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:32.959932 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:33.270145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:33.278493 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-71ac83cd-6007-4d5a-93ce-7ae30ec34f38 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.390962 May 18 14:57:33.284883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 125/243] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:32 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:33.290089 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:33.290704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:33.297697 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:33.298304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:33.299222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:33.299660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:33.639297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:33.656118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:33.657682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:33.658876 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b564996e-a5b4-4971-916b-a3bd6e5e3e4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.731623 May 18 14:57:33.659743 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 119/244] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:32 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:33.694960 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:33.731503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4488025b-4928-4cc6-b63e-41bbc076cd60 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1363 microversion: 2.1 time: 0.445898 May 18 14:57:33.738853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 126/245] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:33 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:34.296012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:34.297190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:34.305058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:34.305719 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:34.306503 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:34.306952 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:34.625821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:34.636157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-101a990b-9d14-41ba-a6b7-c493ed0979c8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.343971 May 18 14:57:34.637615 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 120/246] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:34 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:34.677901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:34.679176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:34.686316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:34.686991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:34.688168 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:34.688808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:34.755407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:34.756304 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:34.763172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:34.763889 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:34.764878 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:34.765455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:35.050378 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:35.060093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:35.070208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:35.071468 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4c55fc36-1933-4f05-90c9-daf1e6757fb3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.398284 May 18 14:57:35.072063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 127/247] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:34 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:35.076708 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1845561488", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "networks": [{"uuid": "b1070a25-b6bd-45ba-8976-aa1e0d09c083"}]}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:35.098688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:35.109762 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-621cf21f-4024-4892-9dff-70495f641c7b tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1549 microversion: 2.1 time: 0.358558 May 18 14:57:35.110480 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 121/248] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:34 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1549 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:35.126331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:35.127303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:35.133977 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:35.134771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:35.135704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:35.136285 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:35.167043 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] validate_networks() for [('b1070a25-b6bd-45ba-8976-aa1e0d09c083', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:57:35.334123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5f489518-a639-4db5-9931-c02a51017482 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211000 May 18 14:57:35.342173 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 122/249] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 14:57:35 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:35.654130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:35.655099 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:35.662043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:35.663149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:35.664350 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:35.665043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:36.112550 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:36.122223 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a40de036-9d25-4cb1-a1c7-5aa981d70274 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.472487 May 18 14:57:36.123587 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 123/250] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:35 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:36.128332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:36.133960 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:36.145214 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:36.145664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:36.146543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:36.146913 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:36.712096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:36.725011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:36.728711 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:36.730709 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2c6ed73d-4285-49be-8ab0-a12c75266d4f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.605461 May 18 14:57:36.737342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 124/251] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:36 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:36.902593 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:57:36.903090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:57:36.903747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:57:36.904419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:57:36.907525 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:57:36.915766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:36.916215 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:36.917041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:36.917474 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:36.937196 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Getting quotas for project a9de5514ed904b8990b1a4f375b01bd9. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:36.944839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Getting quotas for user 6115ac6231d6421c913b5b6e9227f9a2 and project a9de5514ed904b8990b1a4f375b01bd9. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:36.957767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:57:36.960923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:57:37.011745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d7f70579-fd17-418a-afd1-9b0765420cb8 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938596 May 18 14:57:37.013082 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 128/252] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:57:37.023494 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-67d9bea9-c98e-47fd-ba8b-0de0989393de tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:37.024381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-67d9bea9-c98e-47fd-ba8b-0de0989393de tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:37.140806 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:37.141629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:37.149578 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:37.150446 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:37.152019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:37.152475 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:37.312334 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-67d9bea9-c98e-47fd-ba8b-0de0989393de tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:37.328413 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-67d9bea9-c98e-47fd-ba8b-0de0989393de tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1214 microversion: 2.1 time: 0.309143 May 18 14:57:37.329137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 125/253] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:37 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:37.566121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:37.575508 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d0a4dfcf-3c17-4fe2-9b53-415c8d31c4ea tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.438631 May 18 14:57:37.586096 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 129/254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:37 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:37.751769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:37.752379 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:37.769246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:37.769802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:37.770642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:37.771605 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:38.091814 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:38.100660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:38.102754 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:38.104372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8cc6760c-5017-4fa8-98a5-4a2ef747f3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.356429 May 18 14:57:38.105128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 126/255] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:37 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:38.218042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-f5333545-b338-4ec2-848b-5fe84139a3d1 req-408ebcb0-9bd2-462a-b123-5893e2c6a859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7efce9-bda4-4d05-a813-164f962babab", "tag": "8c977413-3f2a-4a40-84bc-101572b4ab37"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:38.221660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:38.236463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f5333545-b338-4ec2-848b-5fe84139a3d1 req-408ebcb0-9bd2-462a-b123-5893e2c6a859 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:38.237079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f5333545-b338-4ec2-848b-5fe84139a3d1 req-408ebcb0-9bd2-462a-b123-5893e2c6a859 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:38.252231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-f5333545-b338-4ec2-848b-5fe84139a3d1 req-408ebcb0-9bd2-462a-b123-5893e2c6a859 service nova] Creating event network-changed:8c977413-3f2a-4a40-84bc-101572b4ab37 for instance ee7efce9-bda4-4d05-a813-164f962babab on hv-cinder-83998 May 18 14:57:38.259852 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-f5333545-b338-4ec2-848b-5fe84139a3d1 req-408ebcb0-9bd2-462a-b123-5893e2c6a859 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045515 May 18 14:57:38.264838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 130/256] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:38.345774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:38.346325 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:38.357821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:38.358699 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:38.360123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:38.361084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:38.384333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=100 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:38.568888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:38.585574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-93d6fb2d-e15b-4c0f-9eaa-6fbbacf32c04 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1274 microversion: 2.1 time: 0.243477 May 18 14:57:38.586594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 127/257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:38 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:38.597605 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:38.598431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:38.647864 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:38.650106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:38.654875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:38.660135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:39.049003 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:39.069413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c7c4518f-67d0-4d75-bdab-66863a04cd95 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.478279 May 18 14:57:39.084476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 131/258] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:38 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:39.126850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:39.128188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:39.140421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:39.141922 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:39.147611 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:39.149700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:39.150980 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:39.461135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:39.475499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:39.477049 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:39.483598 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6e2ecb67-53f9-40eb-afb1-bd10b1527c75 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.363919 May 18 14:57:39.492267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 128/259] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:39 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:39.605031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:39.605596 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:39.612042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:39.612839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:39.613660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:39.614103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:39.731769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:39.743666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-57dc9dff-3cda-47a2-9ba9-f671eb578349 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1272 microversion: 2.1 time: 0.142621 May 18 14:57:39.745504 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 132/260] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:39 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:40.089388 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:40.090385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:40.097797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:40.098616 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:40.101588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:40.102582 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:40.475509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:40.488840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-499f531a-b1e4-4c81-bda7-5aa675a2f6d1 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.400720 May 18 14:57:40.490330 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 129/261] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:40 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:40.504933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:40.506416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:40.516303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:40.519164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:40.520267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:40.522431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:40.708230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:40.719063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:40.721455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:40.724101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-aa31dab5-f590-4406-94cf-3b3a2e2bf819 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.223327 May 18 14:57:40.734782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 133/262] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:40 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:40.761322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:40.761971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:40.768175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:40.768647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:40.769865 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:40.770459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:40.932485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:40.942201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-30dc0a51-1120-41a1-b28d-ef5145ba0e9c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.184781 May 18 14:57:40.945939 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 130/263] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:40 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:41.508708 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:41.509570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:41.522865 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:41.523567 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:41.524713 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:41.525326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:41.744011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:41.746741 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:41.775986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:41.777346 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:41.780637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:41.782094 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:41.881844 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:41.899032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e99db4a8-e639-4da4-93fa-90bc49d64f62 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.394862 May 18 14:57:41.899630 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 134/264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:41 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:41.962140 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:41.963338 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:41.982079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:41.983098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:41.984211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:41.988787 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:42.431511 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:42.442581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4a2564c9-eb97-46c4-a454-709edf5cf6c6 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.486957 May 18 14:57:42.452660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 135/265] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:41 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:42.479617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:42.493436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:42.495703 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:42.497141 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5e860b94-4b4e-4f45-b89e-64f69a18b007 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.757180 May 18 14:57:42.498064 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 131/266] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:41 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:42.680974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-26780615-93be-4dee-8217-2f73288edadb req-d5530d5a-795b-4166-afaf-9a669c841141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d150bfcf-f511-42be-afcf-90d9c8c6e9ca", "tag": "a8034ac0-d5ed-464c-bb2c-34709b97009e"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:42.696873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-26780615-93be-4dee-8217-2f73288edadb req-d5530d5a-795b-4166-afaf-9a669c841141 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:42.696873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-26780615-93be-4dee-8217-2f73288edadb req-d5530d5a-795b-4166-afaf-9a669c841141 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:42.720697 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-26780615-93be-4dee-8217-2f73288edadb req-d5530d5a-795b-4166-afaf-9a669c841141 service nova] Creating event network-changed:a8034ac0-d5ed-464c-bb2c-34709b97009e for instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca on hv-cinder-83998 May 18 14:57:42.726331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-26780615-93be-4dee-8217-2f73288edadb req-d5530d5a-795b-4166-afaf-9a669c841141 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051956 May 18 14:57:42.727308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 136/267] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:42.917042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:42.918493 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:42.927658 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:42.928380 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:42.929392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:42.930037 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:43.151598 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:43.171609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-dfb24392-b4e2-4ad3-ab5b-b727df139a8a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.258565 May 18 14:57:43.184010 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 132/268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:42 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:43.468224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:43.468949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:43.478978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:43.479616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:43.480656 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:43.481256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:43.518724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:43.519145 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:43.542601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:43.543055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:43.543851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:43.544281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:43.964547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:43.994720 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:44.000071 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:44.006475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b31ae18b-7b49-472e-affb-fbded11a4ef1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.494979 May 18 14:57:44.012051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 133/269] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:43 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:44.073627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:44.093975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-24984d75-d6ef-4777-9cf8-a6ce9a893d5f tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.636882 May 18 14:57:44.096361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 137/270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:43 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:44.203716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:44.204440 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:44.217199 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.217668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.218444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.218877 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.514032 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:44.526588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3388429c-bf9e-4719-bd8a-d6a71fc7359e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1501 microversion: 2.1 time: 0.328408 May 18 14:57:44.543856 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 134/271] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:44 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1501 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:44.550177 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "531ca0b7-7e73-4143-98b4-6f7110eecba7"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:44.551791 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:44.562515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.563432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.564441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.565330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.609022 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] HTTP exception thrown: Cannot 'attach_volume' instance 447f7721-8ce1-4cbe-996a-75b2426474bc while it is in vm_state rescued May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Request method failure captured: May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/os-volume_attachments HTTP/1.1 May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 74 May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjzVOTjOi0UiEostiqI8ORWnqTPMC1uMYluYnsq9j1moIP6jSgbXlZrFRGpt9SM4Md2HF7vcqiZefPkY1vDMbeaAEyZN5aEPjVeRqy6qRee47nQd0LqLnmb0hbFoGvoRer5ZUXDJhPBipl02_RJgfLVdDXmycR5z6fYJ-02NDeJs-A May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 84835592358a4e188df86896d6015647 May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:57:44.617308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/84835592358a4e188df86896d6015647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_84835592358a4e188df86896d6015647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168859250 May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 84835592358a4e188df86896d6015647 May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 2aa34e012c824754833a12ac66413aaf May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {"volumeAttachment": {"volumeId": "531ca0b7-7e73-4143-98b4-6f7110eecba7"}} May 18 14:57:44.618706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Cannot 'attach_volume' instance 447f7721-8ce1-4cbe-996a-75b2426474bc while it is in vm_state rescued May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'server_id': '447f7721-8ce1-4cbe-996a-75b2426474bc', 'body': {'volumeAttachment': {'volumeId': '531ca0b7-7e73-4143-98b4-6f7110eecba7'}}} May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc in vm_state rescued. Cannot attach_volume while the instance is in this state. May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:57:44.619510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 447f7721-8ce1-4cbe-996a-75b2426474bc while it is in vm_state rescued May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:44.620949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:44.622264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:57:44.622264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:57:44.622264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 447f7721-8ce1-4cbe-996a-75b2426474bc while it is in vm_state rescued May 18 14:57:44.622264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:57:44.622264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Returning 409 to user: Cannot 'attach_volume' instance 447f7721-8ce1-4cbe-996a-75b2426474bc while it is in vm_state rescued {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:57:44.623237 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-65d35407-7b2d-4103-92a7-3fc9720449cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077845 May 18 14:57:44.624212 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 138/272] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 14:57:44 2022] POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 14:57:44.635528 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:44.636066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:44.644998 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.645716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.647256 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.647862 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.734597 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c3b4e9c9-989c-48ee-a16a-8edfa553831b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/action" status: 202 len: 0 microversion: 2.1 time: 0.102419 May 18 14:57:44.742081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 135/273] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:57:44 2022] POST /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:57:44.749016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:44.752352 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:44.763095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.763930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:44.765056 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:44.765718 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:45.038833 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:45.041102 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:45.054785 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:45.056156 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:45.057685 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:45.059783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:45.065948 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:45.075403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8e4f2ee7-28d5-47dd-b813-c0083f1ddb1a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1509 microversion: 2.1 time: 0.335016 May 18 14:57:45.076317 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 139/274] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:44 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:45.111617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:45.112570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:45.120164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:45.121713 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:45.122896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:45.123581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:45.306125 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:45.316188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:45.319040 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:45.320621 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1407d41d-1538-451b-9d55-124269e92c40 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.293890 May 18 14:57:45.321377 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 136/275] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:45 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:45.340244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:45.347825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-01c78945-9970-4ba6-958a-c054fe2a4faf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.240483 May 18 14:57:45.348433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 140/276] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:45 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:45.504117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c00f000c-258d-40f6-8ff6-36e4d23244f0 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Action: 'create', calling method: .version_select at 0x7fa8a0b78b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-658147559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fGuNKKd9kCPu5yMf8PEf7x0vDVFNhfKeLWbUahuJ/kF/ei9XdcViVCCNL+39D/RGSWH3fu3uy8ch0ouQdKUUs8SlIYl5qlJv0q+s5gslmS0daDPtEStqkxqaBSiN0Og=="}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:45.519702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-c00f000c-258d-40f6-8ff6-36e4d23244f0 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Getting quotas for project 379bba80af244096abbf8deb82772854. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:45.527004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-c00f000c-258d-40f6-8ff6-36e4d23244f0 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Getting quotas for user c9a0569d0a7641a9858c0810219b1ef8 and project 379bba80af244096abbf8deb82772854. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:45.555750 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c00f000c-258d-40f6-8ff6-36e4d23244f0 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.233087 May 18 14:57:45.556696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 137/277] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 14:57:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:46.093070 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:46.093730 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:46.107923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:46.108720 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:46.109864 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:46.110523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:46.340976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:46.342175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:46.350499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:46.351233 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:46.352251 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:46.352835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:46.357078 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:46.367941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e1008bce-0847-46b9-84c3-d2dd396865d8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1509 microversion: 2.1 time: 0.278931 May 18 14:57:46.368917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 141/278] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:46 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:46.373875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:46.378460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:46.389026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:46.389759 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:46.390902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:46.391625 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:46.910241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:46.920801 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:46.923278 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:46.924697 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7937204b-c629-485e-9aa7-8be19b657458 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.589554 May 18 14:57:46.925526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 138/279] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:46 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:57:46.937411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:46.937411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:46.944037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7e40da20-9cf3-4a65-bad1-a312608a6c92 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.573734 May 18 14:57:46.944637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 142/280] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:46 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:47.386074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:47.387900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:47.390440 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:47.395427 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:47.396495 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:47.397415 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:47.397926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:47.417597 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:47.568458 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:47.576286 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-25ce3327-d3cd-4460-95f1-1d8e91156b78 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1509 microversion: 2.1 time: 0.194604 May 18 14:57:47.576892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 143/281] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:47 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:47.943373 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:47.943978 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:47.951278 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:47.951735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:47.952529 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:47.953097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:47.967412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:47.968797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:47.980250 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:47.981155 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:47.982065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:47.982613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:48.192992 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:48.204172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:48.206555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:48.207945 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e4edb9d0-9265-4c06-b849-12b1c42f7814 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.268566 May 18 14:57:48.209686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 139/282] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:47 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:48.242600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:48.250315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-aa5a30c8-b418-49bd-8ac2-b21b0255acec tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.293444 May 18 14:57:48.251561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 144/283] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:47 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:48.594143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:48.594880 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:48.601167 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:48.601724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:48.602565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:48.603075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:48.779463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:48.787345 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0e5f8f46-e377-4615-b24c-8289d0a5020a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1509 microversion: 2.1 time: 0.197134 May 18 14:57:48.788105 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 140/284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:48 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:49.229646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:49.230251 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:49.244898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.245625 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.246632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.247072 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.267779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:49.269418 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:49.281633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.282423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.283385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.284771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.595152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:49.608016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:49.609870 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:49.611751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bf73d5db-4422-4c09-82df-4c3e1d7e22c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.386041 May 18 14:57:49.612401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 145/285] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:49 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:49.617964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-d35586fe-4fc7-4241-8039-c22c6826cd46 req-7af37d03-1350-485b-b908-46af37057387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d150bfcf-f511-42be-afcf-90d9c8c6e9ca", "name": "network-vif-plugged", "status": "completed", "tag": "a8034ac0-d5ed-464c-bb2c-34709b97009e"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:49.627264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:49.629216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-d35586fe-4fc7-4241-8039-c22c6826cd46 req-7af37d03-1350-485b-b908-46af37057387 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.629979 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-d35586fe-4fc7-4241-8039-c22c6826cd46 req-7af37d03-1350-485b-b908-46af37057387 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.641295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-23390674-b3f5-4ab1-a0fb-8cc8b6c51130 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.377669 May 18 14:57:49.651782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 141/286] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:49 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:49.656204 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-d35586fe-4fc7-4241-8039-c22c6826cd46 req-7af37d03-1350-485b-b908-46af37057387 service nova] Creating event network-vif-plugged:a8034ac0-d5ed-464c-bb2c-34709b97009e for instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca on hv-cinder-83998 May 18 14:57:49.664435 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-d35586fe-4fc7-4241-8039-c22c6826cd46 req-7af37d03-1350-485b-b908-46af37057387 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050696 May 18 14:57:49.668185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 146/287] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:57:49.806813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:49.807683 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:49.813897 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.814442 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.815224 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:49.815662 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:49.978395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:49.986614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e99fefd1-31f5-457d-bb41-ccdaf77b039d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1515 microversion: 2.1 time: 0.184306 May 18 14:57:49.987193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 142/288] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:49 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:50.631746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:50.632441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:50.638866 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:50.639339 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:50.640104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:50.640539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:50.658774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:50.659524 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:50.666267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:50.666820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:50.667596 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:50.668193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:50.843243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:50.847119 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:50.851846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:50.853389 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:50.854558 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1c554d39-9d97-4bc5-bc5c-53d296ea681f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.227047 May 18 14:57:50.855004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a68f255a-308d-4cc8-a038-2d2108ba545c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1314 microversion: 2.1 time: 0.199975 May 18 14:57:50.855116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 147/289] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:50 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:50.855557 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 143/290] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:50 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:51.325379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8bc45d99-ca6d-4874-b37d-ac2bdcdfcc2e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'create', calling method: .version_select at 0x7fa8a0b88e50>, body: {"keypair": {"name": "tempest-keypair-1655765253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF47AztyytskUspJC/ochVLE6KQiUALkQ3zYga6dIBWLiEUzl2E681DWyrSZvUDUsknTUZL+d68eI6HJfYOUz4VTPRR7iCX5HC33xfPTipSsibQh1NnSCeoJWCzQEJ47Dg=="}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:51.339242 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-8bc45d99-ca6d-4874-b37d-ac2bdcdfcc2e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for project 84835592358a4e188df86896d6015647. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:51.343074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-8bc45d99-ca6d-4874-b37d-ac2bdcdfcc2e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for user 2aa34e012c824754833a12ac66413aaf and project 84835592358a4e188df86896d6015647. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:51.374974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8bc45d99-ca6d-4874-b37d-ac2bdcdfcc2e tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053285 May 18 14:57:51.375490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 148/291] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 14:57:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:51.871565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:51.872972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:51.873303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:51.874016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:51.880687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:51.880833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:51.881090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:51.881220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:51.881974 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:51.882235 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:51.882415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:51.882811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:51.886938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:52.101566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:52.105488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:52.112730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9876e762-45f4-4515-b04d-9c7a30d08dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1497 microversion: 2.1 time: 0.245008 May 18 14:57:52.113522 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 144/292] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:51 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:52.114180 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:52.116348 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:52.117557 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-de74ba18-f39a-483b-b4ba-8d3e7433d945 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.248585 May 18 14:57:52.129634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 149/293] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:51 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:57:52.754605 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:52.755149 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-921177169", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22bd5425-6379-4740-b6c4-d6f9b7aaeddb"}], "security_groups": [{"name": "tempest-securitygroup--2025069190"}], "key_name": "tempest-keypair-1655765253", "user_data": "}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:52.755325 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:52.761324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:52.761773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:52.762536 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:52.762967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:52.788306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 14:57:52.874959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7e6015df-7b34-4064-8155-dd694d421127 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 204 len: 0 microversion: 2.1 time: 0.123945 May 18 14:57:52.875581 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 145/294] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 14:57:52 2022] DELETE /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 14:57:52.884440 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:52.885186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] validate_networks() for [('22bd5425-6379-4740-b6c4-d6f9b7aaeddb', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:57:52.885685 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:52.891963 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:52.892410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:52.893236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:52.893660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:53.090836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:53.098190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-026e20e3-2a32-4e5a-aa1b-0c35cd028cfd tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1503 microversion: 2.1 time: 0.218352 May 18 14:57:53.098783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 146/295] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:52 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:53.135801 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:53.136398 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:53.142466 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:53.142907 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:53.143660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:53.144090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:53.370786 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:53.379002 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:53.381117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:53.382282 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-85a97a5e-f74c-4101-ac19-3f9a03ab69b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.250415 May 18 14:57:53.382837 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 147/296] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:53 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:57:53.415740 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:57:53.416169 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:57:53.416700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:57:53.417116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:57:53.417667 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:57:53.427754 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:53.428204 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:53.429173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:53.429614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:53.447592 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for project 84835592358a4e188df86896d6015647. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:53.451620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Getting quotas for user 2aa34e012c824754833a12ac66413aaf and project 84835592358a4e188df86896d6015647. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:53.462700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:57:53.465000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:57:53.510322 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1cf7b3e5-195a-498c-9e26-31e6a4634efc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.759449 May 18 14:57:53.510970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 150/297] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:57:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:57:53.520938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b1dece60-89ee-4b8c-8383-5e40ce34db79 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:53.521824 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b1dece60-89ee-4b8c-8383-5e40ce34db79 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:53.588423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b1dece60-89ee-4b8c-8383-5e40ce34db79 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:53.595542 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b1dece60-89ee-4b8c-8383-5e40ce34db79 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1245 microversion: 2.1 time: 0.078485 May 18 14:57:53.596635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 148/298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:53 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:54.115438 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:54.116779 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:54.123552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:54.123552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:54.123932 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:54.124361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:54.255548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:54.262942 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-63df2c80-5244-4c17-8226-4ed33e504025 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1503 microversion: 2.1 time: 0.151941 May 18 14:57:54.263503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 151/299] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:54 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:54.400948 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:54.401560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:54.409190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:54.409644 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:54.410630 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:54.411182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:54.540872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:54.550557 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:54.552800 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:54.554158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fc434135-4da3-4f63-af31-e78039b7e81e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.157039 May 18 14:57:54.554851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 149/300] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:54 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:54.613447 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:54.614141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:54.620234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:54.620762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:54.621528 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:54.621966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:54.695243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:54.702548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-44f19b03-336f-42c0-9009-67dbf58b90e4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1249 microversion: 2.1 time: 0.093117 May 18 14:57:54.703107 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 152/301] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:54 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:55.279326 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:55.279934 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:55.285835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.286798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.287548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.287981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.339229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-c8711f89-1743-4aae-8768-8cd2fa1483ce req-6fea996a-f636-4325-90b0-2e63f648f971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "name": "network-vif-plugged", "status": "completed", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:55.348095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-c8711f89-1743-4aae-8768-8cd2fa1483ce req-6fea996a-f636-4325-90b0-2e63f648f971 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.349373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-c8711f89-1743-4aae-8768-8cd2fa1483ce req-6fea996a-f636-4325-90b0-2e63f648f971 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.361241 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-c8711f89-1743-4aae-8768-8cd2fa1483ce req-6fea996a-f636-4325-90b0-2e63f648f971 service nova] Creating event network-vif-plugged:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:57:55.366952 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-c8711f89-1743-4aae-8768-8cd2fa1483ce req-6fea996a-f636-4325-90b0-2e63f648f971 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031642 May 18 14:57:55.367549 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 153/302] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:55.464513 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:55.472202 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f26fe65a-74b2-43e8-bea8-3e273c3227eb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1503 microversion: 2.1 time: 0.196784 May 18 14:57:55.473086 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 150/303] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:55 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:55.573695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:55.574376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:55.583362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.583876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.584754 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.585246 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.720984 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:55.721892 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:55.728904 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.729573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.730343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:55.730966 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:55.850265 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:55.858247 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f8fe949e-8ad4-4e4e-a76d-bcc587192dad tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1303 microversion: 2.1 time: 0.142460 May 18 14:57:55.859259 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 151/304] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:55 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:55.917263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:55.925469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:55.927922 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:55.929118 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c9fd4717-a833-4a54-a58e-79923da34ad3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.361246 May 18 14:57:55.929685 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 154/305] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:55 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:56.159035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-bdca7d5a-3b9c-4307-8889-fc0ca46d7279 req-026f128e-fdae-4fff-b7b3-60a1fb115bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d150bfcf-f511-42be-afcf-90d9c8c6e9ca", "name": "network-vif-deleted", "tag": "a8034ac0-d5ed-464c-bb2c-34709b97009e"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:56.167816 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-bdca7d5a-3b9c-4307-8889-fc0ca46d7279 req-026f128e-fdae-4fff-b7b3-60a1fb115bb6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.168254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-bdca7d5a-3b9c-4307-8889-fc0ca46d7279 req-026f128e-fdae-4fff-b7b3-60a1fb115bb6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.181523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-bdca7d5a-3b9c-4307-8889-fc0ca46d7279 req-026f128e-fdae-4fff-b7b3-60a1fb115bb6 service nova] Creating event network-vif-deleted:a8034ac0-d5ed-464c-bb2c-34709b97009e for instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca on hv-cinder-83998 May 18 14:57:56.189761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-bdca7d5a-3b9c-4307-8889-fc0ca46d7279 req-026f128e-fdae-4fff-b7b3-60a1fb115bb6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 May 18 14:57:56.190534 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 152/306] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:56.490693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:56.491818 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:56.500167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.500711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.501592 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.502033 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.537181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.537988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.538591 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lazy-loading 'fault' on Instance uuid d150bfcf-f511-42be-afcf-90d9c8c6e9ca {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:57:56.612315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:56.621715 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-37e72cb2-6281-408c-bd3c-c65423206838 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 200 len: 1304 microversion: 2.1 time: 0.136366 May 18 14:57:56.622483 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 155/307] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:56 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:56.882205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:56.884527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:56.897273 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.897931 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.898868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.899305 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.947524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:56.948145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:56.955534 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.955997 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:56.957208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:56.957669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:57.219710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:57.230264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-17cee334-4bdb-465d-a9c6-93f6c899831f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.357293 May 18 14:57:57.232620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:57.237135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 153/308] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:56 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:57.247405 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:57.250361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:57.252122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0e6daea4-af26-4070-a773-fd8e5162a904 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.308512 May 18 14:57:57.252811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 156/309] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:56 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:57:57.639316 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:57.639933 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: d150bfcf-f511-42be-afcf-90d9c8c6e9ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:57.646663 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:57.647441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:57.648392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:57.648856 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:57.664783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] HTTP exception thrown: Instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca could not be found. May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Request method failure captured: May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca HTTP/1.1 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQlcYkh9MAf7Kpog1PQ2U6qo7BmRTDwBcBt_xGVFbv8BOsXTm4ZLvwguj_DSqZwumJNAPnR5Ax_BQVl7OXSw3x2j-tgRnxbxfdx6wScevgIGvmcwhlZiVJTkH5an2HhXanb2FYLEJAF5p4ADDukAcZcwpqRmfkLeiTQ8405zXGlapE8 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: a9de5514ed904b8990b1a4f375b01bd9 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesActionsTest-332300397 May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:57:57.666375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesActionsTest-332300397 May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: a9de5514ed904b8990b1a4f375b01bd9 May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesActionsTest-332300397 May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesActionsTest-332300397-project May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 6115ac6231d6421c913b5b6e9227f9a2 May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesActionsTest-332300397-project May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca could not be found. May 18 14:57:57.667647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'd150bfcf-f511-42be-afcf-90d9c8c6e9ca'} May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca could not be found. May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:57:57.668395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca could not be found. May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca could not be found. May 18 14:57:57.670139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:57:57.671237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Returning 404 to user: Instance d150bfcf-f511-42be-afcf-90d9c8c6e9ca could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:57:57.671237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-407db492-7e9d-4c43-8259-7c0075ef0fcb tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca" status: 404 len: 111 microversion: 2.1 time: 0.032522 May 18 14:57:57.671237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 154/310] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:57 2022] GET /compute/v2.1/servers/d150bfcf-f511-42be-afcf-90d9c8c6e9ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 14:57:57.773603 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-160839745", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "networks": [{"uuid": "b1070a25-b6bd-45ba-8976-aa1e0d09c083"}]}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:57.823320 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] validate_networks() for [('b1070a25-b6bd-45ba-8976-aa1e0d09c083', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:57:58.218611 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-a4c12875-75ed-42b5-ac1c-fd8c8f9c087d req-698b4808-06d7-4d43-81f7-c8af3a7fa81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029fe182-8e95-49ca-88da-64523afce432", "tag": "b2e8b9ad-823b-4ddb-820c-d6a26d7edf96"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:57:58.227203 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-a4c12875-75ed-42b5-ac1c-fd8c8f9c087d req-698b4808-06d7-4d43-81f7-c8af3a7fa81c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.227729 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-a4c12875-75ed-42b5-ac1c-fd8c8f9c087d req-698b4808-06d7-4d43-81f7-c8af3a7fa81c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.238899 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-a4c12875-75ed-42b5-ac1c-fd8c8f9c087d req-698b4808-06d7-4d43-81f7-c8af3a7fa81c service nova] Creating event network-changed:b2e8b9ad-823b-4ddb-820c-d6a26d7edf96 for instance 029fe182-8e95-49ca-88da-64523afce432 on hv-cinder-83998 May 18 14:57:58.246034 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-a4c12875-75ed-42b5-ac1c-fd8c8f9c087d req-698b4808-06d7-4d43-81f7-c8af3a7fa81c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029361 May 18 14:57:58.246034 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 155/311] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:57:58.251816 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:58.252529 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:58.260980 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.261818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.263199 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.263649 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.475357 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:58.482709 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-df064104-cd26-4708-8d12-ceebd8bbb896 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.236354 May 18 14:57:58.483279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 156/312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:58 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:58.487823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:58.488428 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:58.490111 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:57:58.490591 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:57:58.491127 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:57:58.491602 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:57:58.492087 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:57:58.494873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.495322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.496088 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.496524 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.501149 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.501598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.502399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:58.502839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:58.520263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Getting quotas for project a9de5514ed904b8990b1a4f375b01bd9. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:57:58.524173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Getting quotas for user 6115ac6231d6421c913b5b6e9227f9a2 and project a9de5514ed904b8990b1a4f375b01bd9. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:57:58.544375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:57:58.544375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:57:58.586772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3f64bc46-87c4-4cd4-8781-858ef0f2fc03 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817471 May 18 14:57:58.587418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 157/313] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:57:58.597986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-92e580e9-4cdd-4f9f-bdd5-1a8ade89beb7 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:58.598609 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-92e580e9-4cdd-4f9f-bdd5-1a8ade89beb7 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:58.607511 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:58.650799 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:58.659150 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:58.660793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:58.662077 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ee32eb12-256a-4401-86f1-651b6419071a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.177894 May 18 14:57:58.662825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 157/314] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:58 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:57:58.668789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-92e580e9-4cdd-4f9f-bdd5-1a8ade89beb7 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:58.675597 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-92e580e9-4cdd-4f9f-bdd5-1a8ade89beb7 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1213 microversion: 2.1 time: 0.081860 May 18 14:57:58.676513 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 158/315] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:58 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:57:59.499913 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:59.500461 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:59.507663 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:59.508196 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:59.509059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:59.509592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:59.644574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:59.653012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-82fa267f-dc1d-4030-be1f-d668dd2fed14 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.156746 May 18 14:57:59.653584 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 158/316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:59 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:59.681167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:59.681758 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:59.688523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:59.689008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:59.689800 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:59.690241 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:59.693693 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:57:59.694307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:57:59.700415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:59.700890 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:59.701664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:57:59.702100 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:57:59.779893 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:59.787218 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-79c764b0-a989-49d0-8b16-f5ff03f1b11e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1217 microversion: 2.1 time: 0.097837 May 18 14:57:59.787779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 159/317] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:57:59 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:57:59.842867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:59.850728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:59.852231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:57:59.853442 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6b36355d-e8b2-4292-841b-7e6cb5e3b545 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.176267 May 18 14:57:59.854018 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 159/318] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:57:59 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:00.670409 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:00.670969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:00.682555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:00.683009 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:00.683828 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:00.684266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:00.807896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:00.809256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:00.816394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:00.817099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:00.818656 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:00.819278 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:00.877730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:00.886956 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6355f372-b741-477f-8cad-82044e3926cb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.220891 May 18 14:58:00.896347 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 160/319] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:00 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:00.896347 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:00.896347 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:00.899537 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:00.899981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:00.901772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:00.902266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:00.902709 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:00.909964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-05bd9a2c-7a5b-445f-aaac-e3ffb42ca738 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1217 microversion: 2.1 time: 0.108445 May 18 14:58:00.919933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 160/320] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:00 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:01.139532 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:01.148555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:01.150283 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:01.151580 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4af51bd3-1001-4af6-8ed5-2b7c7653c318 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1743 microversion: 2.20 time: 0.262602 May 18 14:58:01.152232 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 161/321] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:00 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:01.903210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:01.903833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:01.909918 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:01.910369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:01.911629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:01.912072 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:01.927320 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:01.928464 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:01.934875 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:01.935731 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:01.936072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:01.936505 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:01.939258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:02.007492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:02.014766 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-63e1f486-7508-4cc6-bf5b-d968a94de0e1 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1283 microversion: 2.1 time: 0.092018 May 18 14:58:02.015327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 162/322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:01 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:02.069119 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:02.076693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-46575b36-b33e-49a4-8cdd-03ebc64bd01a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.177193 May 18 14:58:02.077355 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 161/323] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:01 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:02.170196 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:02.170730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:02.177621 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:02.178067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:02.178823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:02.179252 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:02.304864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:02.312735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:02.314251 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:02.315406 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e0f18dba-502e-42f7-a352-b56916f47217 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.149143 May 18 14:58:02.315970 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 163/324] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:02 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:03.031502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:03.032117 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:03.040478 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:03.041135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:03.042008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:03.042449 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:03.093557 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:03.094673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:03.102018 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:03.102477 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:03.103254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:03.104042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:03.106390 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:03.116441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-84a02a35-af4d-4c14-9ef4-21fc266fa9f5 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1283 microversion: 2.1 time: 0.088267 May 18 14:58:03.118561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 162/325] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:03 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1283 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:03.335005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:03.335611 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:03.342721 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:03.343181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:03.343949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:03.344385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:03.400490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:03.410168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a761a136-40d2-4197-9dd3-50ff2541fa3a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.320457 May 18 14:58:03.410744 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 164/326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:03 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:03.632669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:03.644363 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:03.646927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:03.648367 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6e2a4539-002d-44e7-8ffb-e9e49d7cac0e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.317869 May 18 14:58:03.648989 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 163/327] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:03 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:04.135717 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:04.137075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:04.139297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=8 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:04.145307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:04.145998 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:04.146944 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:04.147384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:04.428829 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:04.430037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:04.444928 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:04.457687 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:04.459121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:04.460368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:04.477723 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:04.517681 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:04.532910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1e30d81c-cc7c-45cf-8c76-2d21d21cb79e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.401226 May 18 14:58:04.534274 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 165/328] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:04 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:04.667841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:04.668717 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:04.675194 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:04.675853 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:04.677783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:04.678841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:04.714203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:04.724365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-de83c898-4b17-41f6-92a9-2417c6ae633b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.300279 May 18 14:58:04.725783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 164/329] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:04 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:04.947463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:04.955923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:04.957484 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:04.958778 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-669db891-0576-4bd0-a53a-89c2b2694dde tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.295950 May 18 14:58:04.959639 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 166/330] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:04 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:05.516719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-155d8ffa-d7a7-4e3c-926c-5a49f5a20500 req-907a320b-bc8f-4a3c-af50-8b2d631d6ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4bb700-92ae-430f-96ae-eafd73b576ef", "tag": "945ececc-a652-4632-8a0d-c875a728bbbb"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:05.537432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-155d8ffa-d7a7-4e3c-926c-5a49f5a20500 req-907a320b-bc8f-4a3c-af50-8b2d631d6ee1 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:05.538021 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-155d8ffa-d7a7-4e3c-926c-5a49f5a20500 req-907a320b-bc8f-4a3c-af50-8b2d631d6ee1 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:05.551645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:05.552880 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:05.569798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:05.571671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:05.576131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-155d8ffa-d7a7-4e3c-926c-5a49f5a20500 req-907a320b-bc8f-4a3c-af50-8b2d631d6ee1 service nova] Creating event network-changed:945ececc-a652-4632-8a0d-c875a728bbbb for instance 9b4bb700-92ae-430f-96ae-eafd73b576ef on hv-cinder-83998 May 18 14:58:05.585735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:05.586191 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:05.601168 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-155d8ffa-d7a7-4e3c-926c-5a49f5a20500 req-907a320b-bc8f-4a3c-af50-8b2d631d6ee1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086894 May 18 14:58:05.609298 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 165/331] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:05.744335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:05.745284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:05.753695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:05.754165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:05.755515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:05.755951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:05.889003 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:05.903157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-530dc68b-3bde-47db-801d-10f3af2e4cef tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.356192 May 18 14:58:05.904292 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 167/332] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:05 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:05.978360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:05.979938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:06.004509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:06.005041 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:06.005824 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:06.006438 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:06.028312 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:06.041723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8d3ed11b-733d-420e-bc6e-16e2d9afa53a tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.303710 May 18 14:58:06.049436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 166/333] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:05 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:06.303475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:06.312866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:06.314863 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:06.316241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7184ff33-ea51-429d-b02e-bd399a891728 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.342796 May 18 14:58:06.316823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 168/334] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:05 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:06.922099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:06.923031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:06.931172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:06.931719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:06.932525 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:06.933160 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:07.059464 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:07.060181 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:07.062420 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:07.070657 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:07.071113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:07.071990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:07.072318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:07.229400 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:07.238818 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-af77894e-d592-4c43-9f38-258d7c5f35f4 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.321548 May 18 14:58:07.240455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 167/335] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:06 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:07.272501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:07.281026 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-512f3fef-f03b-478f-b6af-ae1310047fd8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.225538 May 18 14:58:07.292281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 169/336] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:07 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:07.336433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:07.337101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:07.345135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:07.345915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:07.346948 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:07.347934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:07.469512 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-67b69d23-04ae-4a77-b4fd-a1a8242ca25f req-8ef450f4-b183-4447-ab2a-a8166f171dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029fe182-8e95-49ca-88da-64523afce432", "name": "network-vif-plugged", "status": "completed", "tag": "b2e8b9ad-823b-4ddb-820c-d6a26d7edf96"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:07.482816 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-67b69d23-04ae-4a77-b4fd-a1a8242ca25f req-8ef450f4-b183-4447-ab2a-a8166f171dc2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:07.485726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-67b69d23-04ae-4a77-b4fd-a1a8242ca25f req-8ef450f4-b183-4447-ab2a-a8166f171dc2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:07.517601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-67b69d23-04ae-4a77-b4fd-a1a8242ca25f req-8ef450f4-b183-4447-ab2a-a8166f171dc2 service nova] Creating event network-vif-plugged:b2e8b9ad-823b-4ddb-820c-d6a26d7edf96 for instance 029fe182-8e95-49ca-88da-64523afce432 on hv-cinder-83998 May 18 14:58:07.528526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-67b69d23-04ae-4a77-b4fd-a1a8242ca25f req-8ef450f4-b183-4447-ab2a-a8166f171dc2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063468 May 18 14:58:07.530162 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 170/337] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:58:07.548794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:07.558030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:07.559619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:07.560992 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-004696cc-2c80-440e-83ad-53be6e765025 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.229644 May 18 14:58:07.561538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 168/338] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:07 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:08.257198 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:08.258555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:08.265444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:08.266097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:08.266963 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:08.267614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:08.298796 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:08.299429 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:08.306750 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:08.307484 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:08.308613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:08.309274 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:08.466011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:08.476701 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-70db550d-202c-4d4f-a9fe-4266709a0177 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.223203 May 18 14:58:08.477501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 171/339] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:08 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:08.512040 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=4 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:08.532723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:08.542612 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-cad472e5-c72f-4ea2-a1bd-3975fc0ad732 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.247797 May 18 14:58:08.543773 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 169/340] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:08 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:08.580113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:08.580654 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:08.588968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:08.589664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:08.590610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:08.591040 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:08.746096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:08.754218 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:08.756254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:08.757499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8569ab2f-8486-4605-890f-d282c9ee6316 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.181373 May 18 14:58:08.758213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 172/341] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:08 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:09.494145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:09.495458 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:09.500611 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=18 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:09.502375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:09.502852 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:09.503660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:09.504134 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:09.560431 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:09.561095 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:09.571377 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:09.572457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:09.573287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:09.573733 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:09.807264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:09.809308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:09.821573 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c596bb13-e319-441e-a334-40534f217f93 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.331773 May 18 14:58:09.823200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-10ce20dc-e3be-4b5d-8b23-10a500be38e6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.266441 May 18 14:58:09.833849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 170/342] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:09 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:09.834234 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 173/343] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:09 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:09.839294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:09.839905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:09.846624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:09.847069 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:09.847842 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:09.848272 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:09.988487 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:09.997609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:09.999184 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:10.000331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8f3978ab-26e6-48db-9402-f09ae80b0f52 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.165016 May 18 14:58:10.000921 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 174/344] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:09 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:10.841233 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:10.842056 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:10.842645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:10.843422 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:10.849733 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:10.850185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:10.850963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:10.851394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:10.851742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:10.852314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:10.853225 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:10.854011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:11.127165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:11.131840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:11.136454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ff91d59d-a8b1-4a3d-bd71-31e65ee08c3c tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.298676 May 18 14:58:11.137129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 171/345] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:10 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:11.140339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8bb6d867-d5c3-4cc8-9562-4e3f9c670df3 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.302852 May 18 14:58:11.140940 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 175/346] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:10 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:11.142019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:11.142772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:11.149275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:11.149714 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:11.150474 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:11.150906 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:11.346034 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:11.354702 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:11.356208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:11.357413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2661c571-c833-4fdf-b1f6-fd3374f616df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.219218 May 18 14:58:11.368628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 172/347] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:11 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:11.740151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-799944312", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-658147559", "security_groups": [{"name": "tempest-secgroup-smoke-107575105"}], "networks": [{"uuid": "4cb14f9c-6f08-4729-8557-f3c05e247fd9"}], "block_device_mapping_v2": [{"uuid": "65057307-93aa-4012-806d-bfdc2e163516", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:11.869902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] validate_networks() for [('4cb14f9c-6f08-4729-8557-f3c05e247fd9', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:58:12.156125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:12.157363 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:12.166357 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.167206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.167992 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.168428 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.364084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:58:12.367888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:58:12.371104 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:58:12.371758 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:58:12.373389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:58:12.389502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:12.401477 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b50232fd-2b23-4e6e-b606-bb9123c36dcf tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.250134 May 18 14:58:12.402225 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 173/348] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:12 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:12.402400 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.403037 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.403969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.404514 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.407537 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:12.408319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:12.416490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.417196 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.418164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.419232 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.425982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Getting quotas for project 379bba80af244096abbf8deb82772854. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:58:12.430594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Getting quotas for user c9a0569d0a7641a9858c0810219b1ef8 and project 379bba80af244096abbf8deb82772854. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:58:12.520903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:58:12.523413 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65057307-93aa-4012-806d-bfdc2e163516',volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:58:12.666915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:12.680644 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-dd749b60-34ee-4963-8c58-80fc836f8977 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1371 microversion: 2.1 time: 0.275107 May 18 14:58:12.681966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 174/349] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:12 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:12.700228 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:12.701221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:12.708761 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.709550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.710544 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:12.711224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:12.784560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0290c2f8-0ebe-4938-8578-e5d235bce9b6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.048493 May 18 14:58:12.790426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 176/350] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:58:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:58:12.795374 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-793f0f9e-7e60-4299-b6de-9cab0ed4b56a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:12.796217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-793f0f9e-7e60-4299-b6de-9cab0ed4b56a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:13.013639 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-793f0f9e-7e60-4299-b6de-9cab0ed4b56a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:13.025449 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-793f0f9e-7e60-4299-b6de-9cab0ed4b56a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1087 microversion: 2.1 time: 0.232607 May 18 14:58:13.026560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 177/351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:12 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1087 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:13.031970 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-e68a3552-45e4-4648-9fc0-b8a83eea1ab3 req-939c24ed-e2b2-4bcc-9135-64d26072945e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4bb700-92ae-430f-96ae-eafd73b576ef", "name": "network-vif-plugged", "status": "completed", "tag": "945ececc-a652-4632-8a0d-c875a728bbbb"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:13.050458 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e68a3552-45e4-4648-9fc0-b8a83eea1ab3 req-939c24ed-e2b2-4bcc-9135-64d26072945e service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.052095 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e68a3552-45e4-4648-9fc0-b8a83eea1ab3 req-939c24ed-e2b2-4bcc-9135-64d26072945e service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:13.055717 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:13.065045 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:13.068426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:13.069831 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-52dfffb8-7104-4431-b8d3-2aab21c36b67 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.373631 May 18 14:58:13.070597 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 175/352] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:12 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:13.085520 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-e68a3552-45e4-4648-9fc0-b8a83eea1ab3 req-939c24ed-e2b2-4bcc-9135-64d26072945e service nova] Creating event network-vif-plugged:945ececc-a652-4632-8a0d-c875a728bbbb for instance 9b4bb700-92ae-430f-96ae-eafd73b576ef on hv-cinder-83998 May 18 14:58:13.092333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-e68a3552-45e4-4648-9fc0-b8a83eea1ab3 req-939c24ed-e2b2-4bcc-9135-64d26072945e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063915 May 18 14:58:13.095868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 178/353] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:13.422269 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:13.423576 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:13.431941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.433012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:13.433934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.434240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:13.585451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:13.594338 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f99d9b08-52a4-4d4e-82d5-2409a3cc3e47 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.178623 May 18 14:58:13.595018 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 176/354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:13 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:13.698695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:13.699419 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:13.705821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.706264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:13.707047 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.707476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:13.903370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:13.914830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e40e1a32-821a-41e2-a090-22308c18ad27 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1564 microversion: 2.1 time: 0.220575 May 18 14:58:13.925420 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 179/355] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:13 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:13.933936 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:13.934458 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:13.940951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.941403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:13.942662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:13.943251 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.030990 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bae63c1a-1cb5-4008-bab3-3807a5e060e2 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100971 May 18 14:58:14.031678 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 177/356] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 14:58:13 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:14.043888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:14.044451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:14.053732 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:14.054438 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.055527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:14.056138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.090052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:14.090892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:14.101649 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:14.102326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.103265 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:14.106073 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.185331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:14.198443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d589bfa5-aaac-4b90-8e52-19b4cf5ab16c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1185 microversion: 2.1 time: 0.158571 May 18 14:58:14.210923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 180/357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:14 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:14.373026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:14.382381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:14.383917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:14.385139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a27ebec6-0eb1-4c93-af6e-00d07a1369fa tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1738 microversion: 2.20 time: 0.298911 May 18 14:58:14.385707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 178/358] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:14 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:14.611343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:14.612078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:14.618702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:14.619149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.619915 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:14.620350 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:14.850947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:14.853266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=100 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:14.859589 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6a01ef70-79df-476f-bd0c-764f1ead5f1b tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1313 microversion: 2.1 time: 0.252199 May 18 14:58:14.860153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 181/359] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:14 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:15.184199 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-64a690d2-b1c9-4ae1-8302-31861e9f2a7b req-2d08e0d8-336a-4a7c-9f2b-ae89dcd37ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029fe182-8e95-49ca-88da-64523afce432", "tag": "b2e8b9ad-823b-4ddb-820c-d6a26d7edf96"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:15.192815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-64a690d2-b1c9-4ae1-8302-31861e9f2a7b req-2d08e0d8-336a-4a7c-9f2b-ae89dcd37ed1 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.193398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-64a690d2-b1c9-4ae1-8302-31861e9f2a7b req-2d08e0d8-336a-4a7c-9f2b-ae89dcd37ed1 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:15.204883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-64a690d2-b1c9-4ae1-8302-31861e9f2a7b req-2d08e0d8-336a-4a7c-9f2b-ae89dcd37ed1 service nova] Creating event network-changed:b2e8b9ad-823b-4ddb-820c-d6a26d7edf96 for instance 029fe182-8e95-49ca-88da-64523afce432 on hv-cinder-83998 May 18 14:58:15.215099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-64a690d2-b1c9-4ae1-8302-31861e9f2a7b req-2d08e0d8-336a-4a7c-9f2b-ae89dcd37ed1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034927 May 18 14:58:15.216303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 179/360] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:15.219140 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:15.219825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:15.229605 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.232817 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:15.233910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.234486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:15.304043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:15.311460 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7a701f8f-3cfc-4d0d-938d-7d5ea47af190 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1193 microversion: 2.1 time: 0.096903 May 18 14:58:15.321547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 182/361] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:15 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:15.403641 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:15.404295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:15.410424 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.410877 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:15.411647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.412090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:15.544469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:15.554181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:15.555799 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:15.557001 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e431ab7e-42d9-4c61-acbc-f70bb76cac5c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1720 microversion: 2.20 time: 0.157663 May 18 14:58:15.557569 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 180/362] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:15 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:15.877382 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:15.878187 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:15.885659 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.886110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:15.886914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:15.887349 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.023848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:16.031559 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6416e112-8835-4c19-b4bf-26157741980e tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1496 microversion: 2.1 time: 0.158023 May 18 14:58:16.032141 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 183/363] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:15 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:16.329170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:16.330419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:16.341214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.342693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.344926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.346867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.484855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:16.494607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4e704f59-5c9c-4080-a7b6-65ef6c0b1fd1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1203 microversion: 2.1 time: 0.170211 May 18 14:58:16.495276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 181/364] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:16 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:16.576471 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:16.578432 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:16.584945 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.585480 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.586331 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.586835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.825291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:16.825950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:16.833949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.834677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.835163 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.835595 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.866585 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 14:58:16.869788 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:16.955471 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-029d05a1-752d-4b3c-a19a-0daf5909f418 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 204 len: 0 microversion: 2.1 time: 0.134303 May 18 14:58:16.959476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 182/365] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 14:58:16 2022] DELETE /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 14:58:16.965953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:16.966682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:16.974790 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.975160 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:16.975928 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:16.976407 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:17.174595 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:17.184432 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:17.186081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:17.187234 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7817559f-7c14-48df-a891-484676d5ac82 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1720 microversion: 2.20 time: 0.615757 May 18 14:58:17.187794 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 184/366] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:16 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1720 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:17.226185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:17.237586 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3e0b8515-af9b-4c26-802e-4bb81420d598 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1502 microversion: 2.1 time: 0.276192 May 18 14:58:17.237693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 183/367] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:16 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:17.512163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:17.512824 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:17.519067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:17.519468 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:17.520837 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:17.521318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:17.749835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:17.765604 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-09583b89-d93d-4881-b69f-2586806625b7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1270 microversion: 2.1 time: 0.257373 May 18 14:58:17.766885 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 185/368] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:17 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:18.207644 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:18.208424 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:18.215082 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:18.215564 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:18.216407 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:18.216921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:18.254079 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:18.255588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:18.261947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:18.262479 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:18.263246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:18.263756 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:18.396372 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:18.410496 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:18.414120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:18.415935 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9e7c426b-efdb-457c-86fc-3f0f6efd00a0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1720 microversion: 2.20 time: 0.212700 May 18 14:58:18.417202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 184/369] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:18 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:18.435358 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:18.443106 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-148c6099-ccd0-4578-beae-9f6b52486b27 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1502 microversion: 2.1 time: 0.192781 May 18 14:58:18.443678 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 186/370] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:18 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:18.788608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:18.789332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:18.796876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:18.797560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:18.798334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:18.798954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.221863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:19.237130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c53d1391-b8f0-42cf-be65-342050e88d0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.456562 May 18 14:58:19.249077 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 185/371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:18 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:19.435343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:19.435958 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:19.442940 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:19.443446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.444227 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:19.444769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.460128 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:19.461263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:19.472708 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:19.473201 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.474463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:19.475697 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.580482 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:19.596975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6559264d-e671-4caa-9913-8d653ff40fbc tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1460 microversion: 2.1 time: 0.137394 May 18 14:58:19.597663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 186/372] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:19 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1460 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:19.608877 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-3076e4fb-14ea-4897-9935-776ea7f84391 req-04a3f497-4ec0-4b52-b034-9569de3cd47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:19.621841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-3076e4fb-14ea-4897-9935-776ea7f84391 req-04a3f497-4ec0-4b52-b034-9569de3cd47c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:19.622421 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-3076e4fb-14ea-4897-9935-776ea7f84391 req-04a3f497-4ec0-4b52-b034-9569de3cd47c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.644890 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-3076e4fb-14ea-4897-9935-776ea7f84391 req-04a3f497-4ec0-4b52-b034-9569de3cd47c service nova] Creating event network-changed:85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb on hv-cinder-83998 May 18 14:58:19.654229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-3076e4fb-14ea-4897-9935-776ea7f84391 req-04a3f497-4ec0-4b52-b034-9569de3cd47c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053305 May 18 14:58:19.654556 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:19.655038 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 187/373] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:19.661888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-d90d04b3-9ba3-4939-9d24-c7be89f2d6c0 req-a2baf3a2-aaea-40e5-9cfa-4f0b50cf518b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4bb700-92ae-430f-96ae-eafd73b576ef", "name": "network-vif-deleted", "tag": "945ececc-a652-4632-8a0d-c875a728bbbb"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:19.664255 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:19.666625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:19.667799 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9ca21276-a1c9-4fdc-8800-431116c625de tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1720 microversion: 2.20 time: 0.236462 May 18 14:58:19.668356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 187/374] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:19 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:19.670977 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-d90d04b3-9ba3-4939-9d24-c7be89f2d6c0 req-a2baf3a2-aaea-40e5-9cfa-4f0b50cf518b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:19.671527 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-d90d04b3-9ba3-4939-9d24-c7be89f2d6c0 req-a2baf3a2-aaea-40e5-9cfa-4f0b50cf518b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:19.685670 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-d90d04b3-9ba3-4939-9d24-c7be89f2d6c0 req-a2baf3a2-aaea-40e5-9cfa-4f0b50cf518b service nova] Creating event network-vif-deleted:945ececc-a652-4632-8a0d-c875a728bbbb for instance 9b4bb700-92ae-430f-96ae-eafd73b576ef on hv-cinder-83998 May 18 14:58:19.691229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-d90d04b3-9ba3-4939-9d24-c7be89f2d6c0 req-a2baf3a2-aaea-40e5-9cfa-4f0b50cf518b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034718 May 18 14:58:19.691828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 188/375] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:20.255424 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:20.256070 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:20.262102 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.262552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.263318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.263757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.394866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:20.402806 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e62ba7aa-485e-4f25-b40b-5e4b76906f54 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.151193 May 18 14:58:20.403366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 188/376] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:20 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:20.577125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-72e4b289-9748-4408-a863-8402ddba2ecc req-ab5e853e-8077-4cb9-b1ff-dbadc16f09f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "name": "network-vif-unplugged", "status": "completed", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:20.589060 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-72e4b289-9748-4408-a863-8402ddba2ecc req-ab5e853e-8077-4cb9-b1ff-dbadc16f09f7 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.589698 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-72e4b289-9748-4408-a863-8402ddba2ecc req-ab5e853e-8077-4cb9-b1ff-dbadc16f09f7 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.603448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-72e4b289-9748-4408-a863-8402ddba2ecc req-ab5e853e-8077-4cb9-b1ff-dbadc16f09f7 service nova] Creating event network-vif-unplugged:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:58:20.608285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-72e4b289-9748-4408-a863-8402ddba2ecc req-ab5e853e-8077-4cb9-b1ff-dbadc16f09f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036183 May 18 14:58:20.608901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 189/377] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:58:20.615098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:20.616269 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:20.622735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.623182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.623950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.624385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.686970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:20.687675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:20.694716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:20.694862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.695294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.696073 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:20.696516 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:20.702246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b368f0b4-3e93-4818-bc9d-d10403f31f46 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1460 microversion: 2.1 time: 0.091081 May 18 14:58:20.702815 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 189/378] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:20 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1460 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:20.824305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:20.832196 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:20.834320 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:20.835479 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f7f6d8a6-529a-4f5d-a380-ca5f63323661 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1720 microversion: 2.20 time: 0.152778 May 18 14:58:20.836042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 190/379] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:20 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:21.420236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:21.420910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:21.427990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.428441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.429249 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.429716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.564176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:21.572417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-73008581-ec92-41f5-a8a0-3d8c6ff52d89 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.156499 May 18 14:58:21.573338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 190/380] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:21 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:21.719931 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:21.720993 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:21.727535 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.727981 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.728801 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.729233 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.760934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.761379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.761825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lazy-loading 'fault' on Instance uuid 9b4bb700-92ae-430f-96ae-eafd73b576ef {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:58:21.809341 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6115ac6231d6421c913b5b6e9227f9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9de5514ed904b8990b1a4f375b01bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:21.817989 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1325622c-7309-4b85-9dc0-cb35f7aa006d tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 200 len: 1303 microversion: 2.1 time: 0.101257 May 18 14:58:21.818605 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 191/381] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:21 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:21.853544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:21.854160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:21.860895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.861347 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.862122 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:21.862566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:21.999748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.009514 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.011371 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.012647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6b818416-10d1-45af-91b8-e334e335cb7f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1723 microversion: 2.20 time: 0.163002 May 18 14:58:22.013447 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 191/382] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:21 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:22.032392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6da8b590-47ff-4d94-a008-42d48509facb"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:22.033615 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:22.040754 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.041563 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.042585 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.043469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.432898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1da41b65-60ea-4da3-98c3-412dc8364a90 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405026 May 18 14:58:22.436622 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 192/383] 10.222.0.59 () {62 vars in 1363 bytes} [Wed May 18 14:58:22 2022] POST /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments => generated 188 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:58:22.565546 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:22.566251 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:22.568258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:22.573950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.574527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.575514 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.576022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.593018 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:22.593645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:22.601294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.601971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.602955 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.603546 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.703198 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b7f42c32-b55d-4d84-8db5-d5678f69e47b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/action" status: 202 len: 0 microversion: 2.20 time: 0.141298 May 18 14:58:22.703986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 192/384] 10.222.0.59 () {62 vars in 1318 bytes} [Wed May 18 14:58:22 2022] POST /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 14:58:22.713086 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:22.713635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:22.721378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.721835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.722745 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.723988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.780106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.790494 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7c576696-f520-4149-a893-79f73f063191 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.204092 May 18 14:58:22.791186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 193/385] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:22 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:22.836938 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:22.837819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] [instance: 9b4bb700-92ae-430f-96ae-eafd73b576ef] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:22.845844 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.846293 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.847062 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:22.849183 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:22.862976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] HTTP exception thrown: Instance 9b4bb700-92ae-430f-96ae-eafd73b576ef could not be found. May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Request method failure captured: May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef HTTP/1.1 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlcYkh9MAf7Kpog1PQ2U6qo7BmRTDwBcBt_xGVFbv8BOsXTm4ZLvwguj_DSqZwumJNAPnR5Ax_BQVl7OXSw3x2j-tgRnxbxfdx6wScevgIGvmcwhlZiVJTkH5an2HhXanb2FYLEJAF5p4ADDukAcZcwpqRmfkLeiTQ8405zXGlapE8 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: a9de5514ed904b8990b1a4f375b01bd9 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-VolumesActionsTest-332300397 May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:58:22.865318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a9de5514ed904b8990b1a4f375b01bd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-VolumesActionsTest-332300397 May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: a9de5514ed904b8990b1a4f375b01bd9 May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-VolumesActionsTest-332300397 May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-VolumesActionsTest-332300397-project May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 6115ac6231d6421c913b5b6e9227f9a2 May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-VolumesActionsTest-332300397-project May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 9b4bb700-92ae-430f-96ae-eafd73b576ef could not be found. May 18 14:58:22.866888 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '9b4bb700-92ae-430f-96ae-eafd73b576ef'} May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4bb700-92ae-430f-96ae-eafd73b576ef could not be found. May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:58:22.867873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4bb700-92ae-430f-96ae-eafd73b576ef could not be found. May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4bb700-92ae-430f-96ae-eafd73b576ef could not be found. May 18 14:58:22.869335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:58:22.872106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] Returning 404 to user: Instance 9b4bb700-92ae-430f-96ae-eafd73b576ef could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:58:22.873354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e66cda88-bb9d-4600-bca3-d09a45a88d16 tempest-VolumesActionsTest-332300397 tempest-VolumesActionsTest-332300397-project] 10.222.0.59 "GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef" status: 404 len: 111 microversion: 2.1 time: 0.042055 May 18 14:58:22.876916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 194/386] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:22 2022] GET /compute/v2.1/servers/9b4bb700-92ae-430f-96ae-eafd73b576ef => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 14:58:22.878682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.889890 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.891433 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:22.892641 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9a7918c9-d671-4a57-8811-39d8c31f7288 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1749 microversion: 2.20 time: 0.183784 May 18 14:58:22.893199 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 193/387] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:22 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:23.808660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:23.809336 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:23.815642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:23.816091 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:23.817728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:23.818493 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:23.912027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:23.912838 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:23.919185 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=8 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:23.922733 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:23.923373 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:23.924318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:23.925114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:24.049804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:24.070134 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-95a86e18-9d40-46fc-bedc-73abd08b01a9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.265712 May 18 14:58:24.087026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 195/388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:23 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:24.140032 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:24.148912 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:24.150753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:24.152160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-38baceb2-b0a7-460e-8cda-9f8b28b4f8bc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1749 microversion: 2.20 time: 0.244640 May 18 14:58:24.153516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 194/389] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:23 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1749 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:25.087628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:25.088245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:25.094455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:25.094900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:25.095680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:25.096131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:25.173902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:25.174444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:25.182872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:25.183327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:25.184100 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:25.184539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:25.282790 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:25.290364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-898c1fd7-dcb4-4b3a-870d-6d46ce404782 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.206564 May 18 14:58:25.291573 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 196/390] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:25 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:25.363207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:25.372079 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:25.373615 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:25.374780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fee6917b-a898-4ca8-a82b-80c25be594fd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1749 microversion: 2.20 time: 0.207338 May 18 14:58:25.375508 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 195/391] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:25 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:25.771803 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:25.772612 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:25.783059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:25.784250 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:25.786655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:25.787267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:25.811568 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:25.822646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-310bb509-91ec-4b5d-9e4f-bbfcf0213983 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/ips" status: 200 len: 145 microversion: 2.1 time: 0.056805 May 18 14:58:25.823740 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 197/392] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 14:58:25 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:26.308160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:26.308989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:26.315910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:26.316501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:26.318091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:26.318635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:26.395966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:26.398619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:26.409014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:26.410086 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:26.412071 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:26.412775 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:26.669067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:26.679050 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-26f1ecfa-4571-4a8f-be2a-0a84c1209ed7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.374837 May 18 14:58:26.679691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 196/393] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:26 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:26.748322 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:26.766799 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:26.768538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:26.769767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9c95cc9f-f99d-45f4-94bc-060827daa80e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1749 microversion: 2.20 time: 0.379571 May 18 14:58:26.770381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 198/394] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:26 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1749 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:27.696256 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:27.697033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:27.705532 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:27.710632 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:27.712990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:27.712990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:27.731315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:27.788857 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:27.789770 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:27.803786 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:27.804840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:27.815416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:27.815915 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:28.108436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:28.124279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-22fc0f70-6ddd-440d-ac05-1b32f49c19e9 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.432701 May 18 14:58:28.125007 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 197/395] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:27 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:28.170267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:28.182724 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:28.184459 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:28.186048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e5ce1f30-31e7-47c1-8bd5-f002f86cfad5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1751 microversion: 2.20 time: 0.402475 May 18 14:58:28.198930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 199/396] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:27 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1751 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:29.141688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:29.142322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:29.149700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:29.150278 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:29.151448 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:29.152186 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:29.206698 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:29.207984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:29.223993 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:29.231866 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:29.232321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:29.233332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:29.233784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:29.468169 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:29.490850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-92249d89-9c56-41ab-82e5-cc76f7c26307 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.352859 May 18 14:58:29.496688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 198/397] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:29 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:29.510257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f93b8c64-e417-4063-9672-99dd188f2816"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:29.514727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:29.529646 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:29.531386 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:29.534583 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:29.539730 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:29.553162 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:29.557299 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:29.561398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:29.580768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d0121eac-d99e-4e8f-9739-94efdec8ac33 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.372353 May 18 14:58:29.583851 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 200/398] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:29 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:30.112386 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1eaf512c-634d-4b97-bb88-5c5608648ddd tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.607770 May 18 14:58:30.121239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 199/399] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 14:58:29 2022] POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:58:30.511762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:30.512383 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:30.525846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:30.526570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:30.527566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:30.531597 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:30.602244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:30.603115 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:30.622477 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:30.631456 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:30.636323 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:30.640251 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:31.101566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:31.114854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:31.118220 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:31.125825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-98e4d2dd-1aad-4666-ae14-bf4e8271ed77 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.530151 May 18 14:58:31.127130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 200/400] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:30 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:31.165224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:31.175057 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-11c2dd5d-558c-4105-93f7-0cc755d75bee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.667299 May 18 14:58:31.177813 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 201/401] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:30 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:32.147894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:32.148606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:32.166753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:32.167485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:32.168436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:32.169059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:32.194860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:32.196486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:32.211423 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:32.212632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:32.216616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:32.217326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:32.672311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:32.688612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:32.690392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:32.694552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e7c54941-0115-48cc-98c6-5e0f109f3e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.550467 May 18 14:58:32.697626 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 201/402] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:32 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:32.808998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:32.827230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8bfabb62-22ee-4bb4-b1a3-51035b5658e1 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.635714 May 18 14:58:32.829780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 202/403] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:32 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:33.715590 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:33.716201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:33.736396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:33.736865 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:33.737653 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:33.738082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:33.847530 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:33.848338 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:33.858110 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:33.866263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:33.867696 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:33.868299 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:34.464332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:34.478559 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:34.480135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:34.497089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fcc51091-881b-4547-87d1-fcd32bff024c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.783998 May 18 14:58:34.497089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 202/404] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:33 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:34.541981 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:34.555891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2d640e1c-061a-49b9-b219-8b8852d7025c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.712965 May 18 14:58:34.560866 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 203/405] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:33 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:35.456046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-568f765c-6aa9-4b86-b61e-1de47ad732ac req-8348d138-d284-4f4b-880c-e6610ab6602c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "name": "network-vif-plugged", "status": "completed", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:35.475376 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-568f765c-6aa9-4b86-b61e-1de47ad732ac req-8348d138-d284-4f4b-880c-e6610ab6602c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:35.475863 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-568f765c-6aa9-4b86-b61e-1de47ad732ac req-8348d138-d284-4f4b-880c-e6610ab6602c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:35.525825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-568f765c-6aa9-4b86-b61e-1de47ad732ac req-8348d138-d284-4f4b-880c-e6610ab6602c service nova] Creating event network-vif-plugged:85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb on hv-cinder-83998 May 18 14:58:35.546563 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:35.547170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:35.568891 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-568f765c-6aa9-4b86-b61e-1de47ad732ac req-8348d138-d284-4f4b-880c-e6610ab6602c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116365 May 18 14:58:35.569488 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 203/406] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:35.572739 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:35.574008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:35.575011 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:35.579172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:35.609897 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:35.610250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:35.641531 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:35.642000 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:35.642795 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:35.648811 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:36.028193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:36.042354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:36.043968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:36.045191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-26796c45-87f8-4224-a95a-e8c4a2427bd2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.502719 May 18 14:58:36.057198 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 204/407] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:35 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:36.142034 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:36.155128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b03bfcad-eda0-4066-ba6e-789e285b0557 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.576244 May 18 14:58:36.155719 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 204/408] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:35 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:37.063302 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:37.064598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:37.078359 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:37.085865 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:37.086721 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:37.093859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:37.177586 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:37.179318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:37.256170 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:37.264269 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:37.287775 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:37.293257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:37.298747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:37.631221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:37.652233 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:37.664304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:37.667137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-430c07e8-935a-4e65-b64f-efe0922fe589 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.606844 May 18 14:58:37.668055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 205/409] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:37 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:37.730396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:37.739358 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b1cfd3d8-1bf9-4ff2-84c1-ad4a9b6805d6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.567612 May 18 14:58:37.748459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 205/410] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:37 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:38.381975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e9540b3f-5afa-4298-a774-890a660a82cc tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:38.392129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e9540b3f-5afa-4298-a774-890a660a82cc tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:38.393081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e9540b3f-5afa-4298-a774-890a660a82cc tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:38.521314 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e9540b3f-5afa-4298-a774-890a660a82cc tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Going to try to stop instance {{(pid=123864) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 18 14:58:38.618856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e9540b3f-5afa-4298-a774-890a660a82cc tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action" status: 202 len: 0 microversion: 2.1 time: 0.242269 May 18 14:58:38.625854 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 206/411] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:58:38 2022] POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:58:38.634875 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:38.636172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:38.653168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:38.654064 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:38.655153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:38.655805 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:38.688505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:38.689267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:38.710629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:38.711920 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:38.712768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:38.713213 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:38.950994 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:38.965972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cb63cc77-f4a4-4a39-8b8c-bd9ab7816480 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.333064 May 18 14:58:38.971385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 206/412] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:38 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:38.985055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:38.985687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:39.000327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:39.001150 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:39.001949 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:39.002386 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:39.027219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:39.038647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:39.045566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:39.052414 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-09a2b1a1-6876-48ce-ae49-6826f9f20043 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.369652 May 18 14:58:39.054319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 207/413] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:38 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:39.325591 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:39.340441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-81b5b866-04e7-4815-a015-d5a2c66c5b8e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.367195 May 18 14:58:39.341121 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 207/414] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:38 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:39.986109 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:39.987776 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:40.000968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:40.003298 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:40.007066 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:40.008003 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:40.073324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:40.073976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:40.086312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:40.089915 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:40.093724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:40.094426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:40.347475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:40.361732 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:40.370262 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3d6f68ad-b799-4e1c-a316-3e6f14bd9bb5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.388741 May 18 14:58:40.370869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 208/415] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:39 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:40.373916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:40.378128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:40.380081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1837ba29-e491-4e32-ad73-9b766614e39a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.311992 May 18 14:58:40.384830 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:40.385714 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:40.388372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 208/416] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:40 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:40.392860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:40.393578 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:40.394624 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:40.395791 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:40.575320 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:40.587966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5e8db32d-0155-47f0-90bd-97ef693406ca tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1258 microversion: 2.1 time: 0.215272 May 18 14:58:40.588933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 209/417] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:40 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1258 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:41.388328 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:41.389051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:41.407564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:41.408013 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:41.408811 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:41.409242 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:41.410126 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:41.411319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:41.428550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:41.429396 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:41.430440 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:41.431053 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:41.833972 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:41.859053 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:41.862861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:41.868115 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e6ebde0a-39f6-4ce0-b7f3-9df6ed19ad12 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.461783 May 18 14:58:41.877685 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 210/418] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:41 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:41.883849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:41.884477 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:41.899042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:41.899502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:41.900324 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:41.900769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:41.909179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:41.918311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9eb7a319-4763-413d-84fd-3790b5bd65b3 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.534793 May 18 14:58:41.919476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 209/419] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:41 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:42.358143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:42.371579 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0a36326e-e1de-4df1-91bf-5c7f77566880 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1443 microversion: 2.1 time: 0.492342 May 18 14:58:42.372677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 211/420] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:41 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1443 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:42.389547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:42.390897 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:42.400232 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:42.406699 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:42.411154 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:42.413943 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:42.706193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:42.719016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-46c48165-4be7-4dbd-943b-64041dbb88da tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1443 microversion: 2.1 time: 0.333111 May 18 14:58:42.729535 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 210/421] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:42 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1443 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:42.923846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:42.928025 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:42.941210 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:42.942486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:42.965158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:42.969216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:42.970163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:42.971427 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:42.972188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:42.974055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:42.974930 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:42.977204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:43.459041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:43.469578 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:43.480075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:43.482103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-816b18c2-bd18-4297-9b18-2841ecb7facc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.582657 May 18 14:58:43.505441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 212/422] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:42 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:43.681507 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:43.696616 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-01789852-d14d-45d1-acf5-6a2a45e4b05c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.765189 May 18 14:58:43.709769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 211/423] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:42 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:44.504055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:44.505297 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:44.516524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:44.517171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:44.518718 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:44.520972 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:44.560103 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:44.715188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:44.716352 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:44.728536 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:44.729295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:44.730249 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:44.731507 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:44.805777 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:44.815970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:44.822999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:44.825682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-efb6d951-a9d5-444f-a8f6-ca732d53eb3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.326622 May 18 14:58:44.845006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 213/424] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:44 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:45.045912 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:45.069411 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a33fb5fd-3639-45a1-a6b5-e37109188d45 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.358390 May 18 14:58:45.079530 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 212/425] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:44 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:45.848884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:45.850876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:45.874039 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:45.881413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:45.886267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:45.886906 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:46.087091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:46.088614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:46.099850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:46.102061 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:46.106770 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:46.107419 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:46.140242 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:46.373029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:46.389087 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:46.390640 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:46.391826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8a0eebed-a086-4179-97a7-ba9a89358a16 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.550335 May 18 14:58:46.392409 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 214/426] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:45 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:46.466453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:46.479215 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-dde837f0-3a6e-42d1-99ee-9514e5fad706 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.392498 May 18 14:58:46.479889 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 213/427] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:46 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:47.420548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:47.423994 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:47.448626 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:47.450365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:47.455443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:47.455962 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:47.499883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:47.501019 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:47.517118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:47.519037 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:47.523464 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:47.527415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:47.775812 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:47.790749 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-87448d5a-d276-4f78-bc87-9ed8b249a4a1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.296499 May 18 14:58:47.800549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 214/428] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:47 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:47.801510 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-a3b39116-4237-417f-93ac-69696f024b29 req-2b64a347-e05f-4c6d-8fbb-94df6aef6329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:47.813877 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-a3b39116-4237-417f-93ac-69696f024b29 req-2b64a347-e05f-4c6d-8fbb-94df6aef6329 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:47.814353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-a3b39116-4237-417f-93ac-69696f024b29 req-2b64a347-e05f-4c6d-8fbb-94df6aef6329 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:47.828843 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-a3b39116-4237-417f-93ac-69696f024b29 req-2b64a347-e05f-4c6d-8fbb-94df6aef6329 service nova] Creating event network-changed:85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb on hv-cinder-83998 May 18 14:58:47.834316 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-a3b39116-4237-417f-93ac-69696f024b29 req-2b64a347-e05f-4c6d-8fbb-94df6aef6329 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041180 May 18 14:58:47.835974 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 215/429] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:47.916050 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:47.939569 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:47.941249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:47.942512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0d066783-2978-4470-acad-208a955a00ab tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.533537 May 18 14:58:47.944539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 215/430] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:47 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:48.809139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:48.810560 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:48.822405 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:48.828366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:48.829501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:48.830127 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:48.963673 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:48.964290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:48.995882 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:48.996912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:48.999757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:49.002191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:49.189206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:49.200878 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-26848a9a-0b8f-476b-aa85-68f108f27905 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.395812 May 18 14:58:49.208998 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 216/431] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:48 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:49.337818 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:49.346881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:49.358666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:49.361391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d895bc7d-b728-4617-94ba-9c22e9978157 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.401584 May 18 14:58:49.362193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 216/432] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:48 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:50.224908 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:50.226201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:50.233997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:50.240658 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:50.242454 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:50.245428 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:50.383065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:50.384560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:50.396541 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:50.397341 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:50.398342 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:50.399000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:50.572092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:50.580176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0663f2ab-ca23-4be8-aed6-6a38052310d1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.359286 May 18 14:58:50.580773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 217/433] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:50 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:50.748935 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:50.779747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:50.785100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:50.788419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-900d3880-0eaa-4be5-ac95-7ab78d7e1fb9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.408913 May 18 14:58:50.790781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 217/434] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:50 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:51.600294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:51.602010 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:51.608534 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:51.609278 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:51.610228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:51.610827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:51.809608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:51.811819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:51.820181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:51.821558 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:51.823405 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:51.824095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:51.874485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:51.892971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0454c715-4969-4889-9ba3-5d47c39d509d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.297460 May 18 14:58:51.902423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 218/435] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:51 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:52.057465 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:52.068642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:52.070411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:52.071777 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ef4d9929-0c50-4044-b0ce-786cb3e1c111 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.267430 May 18 14:58:52.072901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 218/436] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:51 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:52.912875 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:52.914746 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:52.922275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:52.922822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:52.923679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:52.924192 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:53.072672 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:53.080933 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-060df201-81ff-4d26-8e8a-30fdbcd46c1a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.174730 May 18 14:58:53.082089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 219/437] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:52 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:53.094704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:53.096000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:53.103158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:53.103682 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:53.104701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:53.105344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:53.262368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:53.272099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:53.273621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:53.274773 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-452b0b95-136c-4bf1-9236-775fdc95d13e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.188911 May 18 14:58:53.275358 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 219/438] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:53 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:54.099360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:54.101158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:54.107916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:54.108375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:54.109233 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:54.109706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:54.290054 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:54.293438 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:54.294689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:54.299074 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ec2ed186-d52d-450f-8c47-82bb3f61fdef tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.204081 May 18 14:58:54.303101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:54.305301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:54.306316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:54.306973 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:54.309051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 220/439] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:54 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:54.453145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:54.462391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:54.464136 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:54.465420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f014fcbe-a52c-43b3-b44f-ff15f20c5344 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.175776 May 18 14:58:54.466166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 220/440] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:54 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:55.316783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:55.317308 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:55.335045 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:55.335490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:55.336289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:55.341507 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:55.484891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:55.486137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:55.493859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:55.495536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:55.496575 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:55.499757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:55.670525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:55.688669 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ab001752-7906-4d89-a214-672b95a95a8c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.374856 May 18 14:58:55.693142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 221/441] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:55 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:55.732661 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:55.742496 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:55.749715 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:55.755392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d8451fd4-0730-4735-bf6d-85ce44203296 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.275045 May 18 14:58:55.765519 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 221/442] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:55 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:58:56.707816 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:56.708423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:56.714835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:56.715512 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:56.716289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:56.716753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:56.775642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:56.776877 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:56.783315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:56.783944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:56.785606 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:56.786242 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:56.941995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:56.953961 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-59e12287-2b75-433c-9d6c-adacbfeaadca tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.250150 May 18 14:58:56.955590 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 222/443] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:56 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:56.973610 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:56.983029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:56.984711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:56.988154 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c6021827-1244-41fd-9956-9f947be016ea tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.215989 May 18 14:58:56.988854 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 222/444] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:56 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:57.281858 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-1d43af2c-ae7d-463c-935f-6c7a875f4bda req-96a34a53-6271-46c3-99d3-77b520125328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "name": "network-vif-plugged", "status": "completed", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:57.297403 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1d43af2c-ae7d-463c-935f-6c7a875f4bda req-96a34a53-6271-46c3-99d3-77b520125328 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:57.297848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1d43af2c-ae7d-463c-935f-6c7a875f4bda req-96a34a53-6271-46c3-99d3-77b520125328 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:57.310717 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-1d43af2c-ae7d-463c-935f-6c7a875f4bda req-96a34a53-6271-46c3-99d3-77b520125328 service nova] Creating event network-vif-plugged:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:58:57.322696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-1d43af2c-ae7d-463c-935f-6c7a875f4bda req-96a34a53-6271-46c3-99d3-77b520125328 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043579 May 18 14:58:57.324798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 223/445] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:57.971637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:57.973410 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:57.986541 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:57.987007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:57.987784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:57.988883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:58.007841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:58.008541 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:58.020516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:58.025286 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:58.026387 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:58.026988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:58.249148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:58.259010 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-dc759bd0-8dce-4494-b81f-a63eb6b22ddb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.291584 May 18 14:58:58.268290 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 223/446] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:57 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:58.283762 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:58.293151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:58.294691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:58.295848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-62397c34-99fd-43e8-87e6-6505c0a5ca4d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.293164 May 18 14:58:58.296403 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 224/447] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:58 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:58:58.325228 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3b0fd7eb-83cf-47f2-a1f2-d8dd7935d172 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Action: 'create', calling method: .version_select at 0x7fa8a0b07160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1712029918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnfGGx5tzaU6IH+Ac0XJofNh1nQ9z+DaeRMEwF6SXMpNQnwNombSBgmhlS6OieiUoK5Bq5GBtZLAN49IOm8+2o4SpJmyp5GYsN/lklwh31FhO/cjy3+MVodA0g6nV+h9w=="}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:58.339146 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-3b0fd7eb-83cf-47f2-a1f2-d8dd7935d172 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Getting quotas for project 51aa9f371a9c4b20bd52f8e251c80711. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:58:58.342990 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-3b0fd7eb-83cf-47f2-a1f2-d8dd7935d172 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Getting quotas for user 0eed26f817524cc292be459f2aaa6f6e and project 51aa9f371a9c4b20bd52f8e251c80711. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:58:58.364445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3b0fd7eb-83cf-47f2-a1f2-d8dd7935d172 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043050 May 18 14:58:58.365065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 224/448] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 14:58:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:58:58.461510 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-847290686", "imageRef": "08c353de-3e78-424d-8130-978efa73c688", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1712029918", "networks": [{"uuid": "5bc950ac-9a60-4db1-9e91-6b6e6f038301"}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:58:58.512525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] validate_networks() for [('5bc950ac-9a60-4db1-9e91-6b6e6f038301', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:58:59.100172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:58:59.100754 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:58:59.101090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:58:59.101503 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:58:59.101916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:58:59.111345 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:59.111724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:59.112526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:59.113033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:59.129900 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Getting quotas for project 51aa9f371a9c4b20bd52f8e251c80711. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:58:59.134686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Getting quotas for user 0eed26f817524cc292be459f2aaa6f6e and project 51aa9f371a9c4b20bd52f8e251c80711. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:58:59.147820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:58:59.150129 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08c353de-3e78-424d-8130-978efa73c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:58:59.204687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a466e9a5-f7e7-40d4-9e0c-00165c073103 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746851 May 18 14:58:59.205353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 225/449] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 14:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 14:58:59.215583 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-73640904-c6b8-4ef0-a5f8-32459fbc4627 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:59.216315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-73640904-c6b8-4ef0-a5f8-32459fbc4627 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:59.276212 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:59.276860 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:59.278369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-73640904-c6b8-4ef0-a5f8-32459fbc4627 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:59.288408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:59.288559 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-73640904-c6b8-4ef0-a5f8-32459fbc4627 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1258 microversion: 2.1 time: 0.076829 May 18 14:58:59.288917 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:59.289580 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 225/450] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:59 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:58:59.298819 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:59.300007 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:59.314998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:58:59.315897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:58:59.325998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:59.327955 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:59.328506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:59.346602 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:58:59.347842 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:58:59.498501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:59.514072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-95df5df5-49e3-4c84-b094-1f52d070815c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.241985 May 18 14:58:59.514702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 226/451] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:58:59 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:58:59.565032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:59.583582 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:59.585501 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:58:59.586839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-84b0d090-e28d-4dbb-829a-fde6b9137295 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.275760 May 18 14:58:59.587789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 226/452] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:58:59 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:59:00.305886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:00.306583 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:00.313294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:00.313747 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:00.314516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:00.314955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:00.377642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:00.386101 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cbd57425-4463-48b1-9f65-191bddb0b1c8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1310 microversion: 2.1 time: 0.084372 May 18 14:59:00.386732 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 227/453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:00 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:00.531877 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:00.532709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:00.539605 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:00.540166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:00.541067 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:00.541579 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:00.605375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:00.605995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:00.612310 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:00.613559 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:00.614637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:00.615081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:00.721055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:00.740691 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9c189131-71f4-4a98-abc8-6f292689c694 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.202220 May 18 14:59:00.740691 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 227/454] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:00 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:00.818137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:00.827749 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:00.830096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:00.831457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0b238ff4-9d72-426c-a2f2-387d64a4599f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1807 microversion: 2.20 time: 0.229951 May 18 14:59:00.833221 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 228/455] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:00 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:59:01.403874 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:01.404493 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:01.415971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:01.416621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:01.417976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:01.418505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:01.650384 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:01.659029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-05a77cdc-4e0c-4497-94fc-b60d75e1794d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.259592 May 18 14:59:01.660295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 228/456] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:01 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:01.748333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:01.749046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:01.755917 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:01.756529 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:01.757335 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:01.757981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:01.852515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:01.853174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:01.859598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:01.860379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:01.861206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:01.861734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:01.955689 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:01.965467 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b340fdd9-4787-4c15-ad3b-3f1bb4ad031e tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.221141 May 18 14:59:01.966328 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 229/457] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:01 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:02.019883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9034a8f1-820f-49e8-8c8e-bcdad154d53f"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:02.026217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:02.026842 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:02.033343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:02.033800 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:02.034638 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:02.035605 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:02.045336 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:02.047175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:02.048448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d8313e71-624a-454c-9427-236a4cbe6bc9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1794 microversion: 2.20 time: 0.201805 May 18 14:59:02.049104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 229/458] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:01 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:59:02.678209 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:02.679640 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:02.690031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:02.693362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:02.694231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:02.695118 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:02.855528 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:02.864497 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-358a0233-2b0f-4b00-8e40-aaae662990ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.191212 May 18 14:59:02.874237 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 230/459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:02 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:02.983507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:02.984372 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:02.992111 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:02.994978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:02.995978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:02.996668 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:03.148092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:03.157992 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f5f8cd09-2d42-42dd-8d72-8a661b141feb tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.178524 May 18 14:59:03.158565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 231/460] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:02 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:03.881212 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:03.881891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:03.888450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:03.888966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:03.889782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:03.890426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:03.895223 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:04.049241 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:04.059523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2cfbc885-ec35-4e9f-ad85-c6b9f3e7d926 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.181994 May 18 14:59:04.068634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 232/461] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:03 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:04.174875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:04.175526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:04.182098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:04.182549 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:04.183345 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:04.183770 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:04.346256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:04.357011 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-29372c48-3139-4c53-a12c-d6977d76f7f6 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.185704 May 18 14:59:04.358052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 233/462] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:04 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:05.077876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:05.078610 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:05.085300 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:05.085745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:05.086497 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:05.086926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:05.232019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:05.239476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1778bae1-c601-4116-ba2f-19da6e2e0116 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.166369 May 18 14:59:05.240064 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 234/463] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:05 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:05.379315 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:05.379928 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:05.395862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:05.396599 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:05.397943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:05.398647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:05.536275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:05.544338 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-12887e59-8548-4dc7-b7fb-df90974f5160 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.171657 May 18 14:59:05.544939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 235/464] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:05 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:06.257045 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:06.257658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:06.264949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:06.265379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:06.266196 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:06.266634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:06.407744 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:06.415066 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7fcaf353-1146-44db-935a-f0c45ed8583c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.162563 May 18 14:59:06.415628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 236/465] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:06 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:06.561488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:06.562008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:06.568908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:06.569394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:06.570202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:06.570650 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:06.711419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:06.719446 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bb2252f1-d980-4ff0-bdc4-a60f074e65b0 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.161849 May 18 14:59:06.720037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 237/466] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:06 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:07.432391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:07.433296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:07.439741 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:07.440194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:07.441005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:07.441448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:07.582889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:07.590416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a5304956-2588-4c81-9a2e-38d2cfb1adf0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.162086 May 18 14:59:07.591185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 238/467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:07 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:07.737453 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:07.738064 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:07.744000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:07.744446 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:07.745248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:07.745686 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:07.887274 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:07.895855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ec674546-9c1c-4bcc-8891-a14120107337 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.162163 May 18 14:59:07.905618 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 239/468] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:07 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:08.607298 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:08.608070 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:08.615053 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:08.615484 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:08.616374 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:08.616793 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:08.819702 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:08.832334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ba1c0106-3d8f-4358-b149-4bf33fa88f2a tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.227587 May 18 14:59:08.833305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 240/469] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:08 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:08.913171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:08.914106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:08.926232 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:08.926695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:08.927846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:08.928355 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:09.116270 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:09.120890 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:09.124797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-afd35746-2cfa-4f07-92c0-904587b4a8ce tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.216028 May 18 14:59:09.128904 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 241/470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:08 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:09.142192 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=6 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:09.850099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:09.850734 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:09.852519 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:09.858647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:09.859095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:09.860090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:09.860741 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:09.998131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:10.005772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d8254b30-3392-4d70-94e8-471fe18dfc35 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.160002 May 18 14:59:10.006547 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 242/471] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:09 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:10.142334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:10.142942 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:10.149784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:10.150228 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:10.151001 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:10.151433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:10.283483 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:10.292422 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0575f930-8951-4e85-b1a1-6402bde35fa4 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1723 microversion: 2.1 time: 0.153943 May 18 14:59:10.293006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 243/472] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:10 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:11.025244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:11.026730 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:11.034923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.035502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.036833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.037323 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.179520 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:11.190548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2eaa8251-29bb-426e-82cd-e51cbd802997 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.170864 May 18 14:59:11.204234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 244/473] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:11 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:11.231662 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:11.243259 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d5593ac4-f1ef-4970-817d-c66c960936ff tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.227785 May 18 14:59:11.243979 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 230/474] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 14:59:02 2022] POST /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments => generated 194 bytes in 9229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:59:11.309033 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:11.309769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:11.315978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.316677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.317654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.318108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.455476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:11.464158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6293b038-ffe1-4793-b974-405723ded614 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1700 microversion: 2.1 time: 0.158764 May 18 14:59:11.464966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 245/475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:11 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:11.482795 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6d3d0c55-5fc7-4307-a39b-47dfb1a4f080 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:11.484805 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:11.491959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d3d0c55-5fc7-4307-a39b-47dfb1a4f080 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.492407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d3d0c55-5fc7-4307-a39b-47dfb1a4f080 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.554539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6d3d0c55-5fc7-4307-a39b-47dfb1a4f080 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Going to try to start instance {{(pid=123865) start /opt/stack/nova/nova/compute/api.py:2730}} May 18 14:59:11.602631 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6d3d0c55-5fc7-4307-a39b-47dfb1a4f080 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action" status: 202 len: 0 microversion: 2.1 time: 0.124501 May 18 14:59:11.603244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 231/476] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:59:11 2022] POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:59:11.611474 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:11.612185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:11.619406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.619894 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.620955 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.621390 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.812122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:11.823714 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b4217495-cd51-4fe2-bf69-a5e139a18717 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1709 microversion: 2.1 time: 0.215850 May 18 14:59:11.834617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 246/477] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:11 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1709 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:11.880852 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-ffa5c3de-6d0a-4ae1-abf7-a1f5125c9a38 req-ffa56568-69a3-4aea-a0a8-1f592470e5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:11.898694 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-ffa5c3de-6d0a-4ae1-abf7-a1f5125c9a38 req-ffa56568-69a3-4aea-a0a8-1f592470e5d6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:11.900253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-ffa5c3de-6d0a-4ae1-abf7-a1f5125c9a38 req-ffa56568-69a3-4aea-a0a8-1f592470e5d6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:11.914021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-ffa5c3de-6d0a-4ae1-abf7-a1f5125c9a38 req-ffa56568-69a3-4aea-a0a8-1f592470e5d6 service nova] Creating event network-changed:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 14:59:11.920001 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-ffa5c3de-6d0a-4ae1-abf7-a1f5125c9a38 req-ffa56568-69a3-4aea-a0a8-1f592470e5d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043553 May 18 14:59:11.920939 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 232/478] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:12.208653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:12.209841 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:12.217354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:12.218005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:12.218789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:12.219398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:12.427032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:12.434687 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8093654d-4b02-4ae5-81ce-a254da36927d tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.231114 May 18 14:59:12.435291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 247/479] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:12 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:12.843026 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:12.843727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:12.850440 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:12.850901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:12.851667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:12.852107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:12.987054 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:12.997476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fc0aded1-2b37-40f8-8938-68982f377b35 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1709 microversion: 2.1 time: 0.159077 May 18 14:59:12.998048 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 233/480] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:12 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:13.452093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:13.452749 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:13.459320 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:13.459771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:13.460535 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:13.461006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:13.614827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:13.618217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=100 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:13.625951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-601a97cd-8fdc-4307-a812-829bf4f3f6b0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.177244 May 18 14:59:13.626548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 248/481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:13 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:14.014461 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:14.015080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:14.021563 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:14.022016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:14.022793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:14.023240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:14.178657 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:14.186501 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-34787dc1-9d0a-4018-b419-56fd1fc13a39 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1709 microversion: 2.1 time: 0.176178 May 18 14:59:14.187067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 234/482] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:14 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:14.646769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:14.647386 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:14.653356 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:14.653815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:14.654580 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:14.655021 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:14.858619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:14.866439 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d6403011-8bba-4dda-a6f5-5ea45799794e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.224193 May 18 14:59:14.867004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 249/483] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:14 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:15.203271 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:15.203981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:15.211092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:15.211543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:15.212316 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:15.212782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:15.353656 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:15.363325 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-94bb09e1-b622-471a-98fd-72e4c9ad80d9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1713 microversion: 2.1 time: 0.163249 May 18 14:59:15.363932 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 235/484] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:15 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:15.895098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:15.895780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:15.901769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:15.902218 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:15.903012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:15.903450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:16.039560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:16.047772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-98354f96-a504-4386-9105-baa81d9de3f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.156681 May 18 14:59:16.048342 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 250/485] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:15 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:17.065460 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:17.066682 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:17.073187 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:17.073637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:17.074402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:17.074840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:17.206151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:17.213758 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-83afdf35-336a-4c20-8ef4-291218fca075 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.152112 May 18 14:59:17.214975 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 236/486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:17 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:17.352569 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-726a0391-9022-4f6e-8ba6-c677e9452c04 req-697aad0c-69df-41d4-bbfd-22fd73283301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "name": "network-vif-plugged", "status": "completed", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:17.360703 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-726a0391-9022-4f6e-8ba6-c677e9452c04 req-697aad0c-69df-41d4-bbfd-22fd73283301 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:17.361167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-726a0391-9022-4f6e-8ba6-c677e9452c04 req-697aad0c-69df-41d4-bbfd-22fd73283301 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:17.376532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-726a0391-9022-4f6e-8ba6-c677e9452c04 req-697aad0c-69df-41d4-bbfd-22fd73283301 service nova] Creating event network-vif-plugged:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 14:59:17.381967 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-726a0391-9022-4f6e-8ba6-c677e9452c04 req-697aad0c-69df-41d4-bbfd-22fd73283301 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 May 18 14:59:17.382573 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 251/487] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:18.232714 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:18.233312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:18.242220 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:18.242947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:18.243733 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:18.244240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:18.372139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:18.380076 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3ae6d881-95c3-46c0-8713-5b2b0956909b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.152545 May 18 14:59:18.380649 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 237/488] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:18 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:18.747684 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:18.748769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:18.754842 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:18.755285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:18.756032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:18.756458 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:18.778030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lazy-loading 'flavor' on Instance uuid 029fe182-8e95-49ca-88da-64523afce432 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:59:18.898978 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7f5c68bc-d6d8-4bfc-8f6c-f30fd7e6bcde tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/action" status: 200 len: 32 microversion: 2.1 time: 0.155577 May 18 14:59:18.899581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 252/489] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:59:18 2022] POST /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 14:59:18.908511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:18.909167 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:18.915538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:18.915985 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:18.916768 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:18.917205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:19.045378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:19.054097 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4a74db30-f5cd-482e-ae98-e49b0aa55368 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.149400 May 18 14:59:19.054662 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 238/490] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:18 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:19.397686 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:19.398509 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:19.404742 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:19.405195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:19.405969 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:19.406406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:19.568240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:19.575836 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7c557fab-fba2-4504-902d-9ee2d996d6f5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1358 microversion: 2.1 time: 0.182916 May 18 14:59:19.576448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 253/491] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:19 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:20.071822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:20.072429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:20.078919 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.079367 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.080114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.080544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.209577 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:20.217403 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-68870e4c-14aa-485c-9c3b-d6deff8810c0 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.149964 May 18 14:59:20.217959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 239/492] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:20 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:20.593163 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:20.593783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:20.600361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.600896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.601853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.602288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.732763 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:20.740203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-df5a4424-1228-4548-8f04-3c741781c6e2 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1549 microversion: 2.1 time: 0.150886 May 18 14:59:20.740804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 254/493] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:20 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:20.756606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:20.757219 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:20.763197 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.763637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.764386 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.764846 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.891985 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:20.899959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-70bfea40-212a-4cb6-b70f-359e05268e66 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1549 microversion: 2.1 time: 0.147167 May 18 14:59:20.900526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 240/494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:20 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:20.915999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:20.919369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:20.920122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Searching by: {'deleted': False, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711'} {{(pid=123864) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 18 14:59:20.926688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.927067 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:20.928099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:20.928526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:21.014264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.multi_cell_list [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 18 14:59:21.107999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9c1aade3-37db-4cb4-b94d-db1ef01d92f6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.195657 May 18 14:59:21.108667 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 255/495] 10.222.0.59 () {58 vars in 1124 bytes} [Wed May 18 14:59:20 2022] GET /compute/v2.1/servers => generated 342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:21.119456 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:21.120071 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:21.126703 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:21.127195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:21.128173 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:21.128754 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:21.235179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:21.235828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:21.242484 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:21.242929 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:21.243686 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:21.244117 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:21.254959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:21.262487 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4d008404-116d-4632-a102-b62c969e3d14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1549 microversion: 2.1 time: 0.146956 May 18 14:59:21.263054 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 241/496] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:21 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:21.379028 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:21.386917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f532dbad-ad85-47b6-aa21-ce3672787fdf tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.155682 May 18 14:59:21.387483 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 256/497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:21 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:22.404533 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:22.405176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:22.411384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:22.411833 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:22.412606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:22.413055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:22.539398 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:22.547257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-17c6b485-4913-44c0-b390-45bcc1310636 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.146627 May 18 14:59:22.547822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 242/498] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:22 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:22.765908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a93b982-ae17-40be-a594-41bee6abe7a8"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:22.767031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:22.773069 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:22.773515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:22.774284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:22.774722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:23.053756 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-cd177562-2e55-4db1-9cb4-9ca19a1c2bea tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291552 May 18 14:59:23.054362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 257/499] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 14:59:22 2022] POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:23.565258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:23.565839 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:23.573072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:23.573523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:23.574292 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:23.574732 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:23.703751 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:23.711655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ca1d4fcb-c4dc-4cd4-9b2a-7c9d975aea90 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.150382 May 18 14:59:23.712213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 243/500] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:23 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:24.730445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:24.731143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:24.737297 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:24.737745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:24.738500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:24.738932 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:24.867684 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:24.875510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-648540e0-5f03-40e9-bd1b-19d1d89ff37c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.149853 May 18 14:59:24.876074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 258/501] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:24 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:25.893116 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:25.893733 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:25.900156 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:25.900631 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:25.901394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:25.901830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:26.028077 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:26.035981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-bce7db55-2f4b-486c-8c16-819080ea7d30 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.146732 May 18 14:59:26.036543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 244/502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:25 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:27.054063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:27.054621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:27.061224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:27.061674 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:27.062443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:27.062885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:27.191273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:27.199291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d96018ad-4d1b-4c69-8df3-2bbd2f4c5998 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.150075 May 18 14:59:27.199859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 259/503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:27 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:28.216390 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:28.217044 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:28.224389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:28.224867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:28.225633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:28.226071 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:28.353606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:28.361554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-51692658-9e99-4a6a-af3e-2776cc61591c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.149066 May 18 14:59:28.362095 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 245/504] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:28 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:29.378485 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:29.379108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:29.386183 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:29.386639 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:29.387414 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:29.387855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:29.516364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:29.524960 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5553d647-4036-4e0a-9514-0b618b8dcb06 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.150218 May 18 14:59:29.525534 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 260/505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:29 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:30.542023 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:30.542803 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:30.549666 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:30.550195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:30.551047 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:30.551572 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:30.585620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:30.586240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:30.588648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=70 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:30.594137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:30.594589 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:30.595382 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:30.595821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:30.733915 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:30.744299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c2afa6f5-08d4-4e8f-bba9-d95497ad124d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.205993 May 18 14:59:30.744928 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 246/506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:30 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:30.763220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:30.771700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-09e66038-bf46-4146-8f9c-646ef47b0457 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1595 microversion: 2.1 time: 0.190673 May 18 14:59:30.772273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 261/507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:30 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1595 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:31.762710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:31.763409 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:31.772260 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:31.772734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:31.773509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:31.773945 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:31.777090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:31.990986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:31.998999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-51e1aaa6-057c-49bb-9c65-cf754a8ec8f6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.240214 May 18 14:59:31.999573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 247/508] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:31 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:32.818204 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-59266236-740a-41f9-be61-3ec1fbb45af7 req-e65c3b0d-d6f0-4db0-a3f9-29192991531b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:32.824746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:32.828101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-59266236-740a-41f9-be61-3ec1fbb45af7 req-e65c3b0d-d6f0-4db0-a3f9-29192991531b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:32.828969 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-59266236-740a-41f9-be61-3ec1fbb45af7 req-e65c3b0d-d6f0-4db0-a3f9-29192991531b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:32.845637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-59266236-740a-41f9-be61-3ec1fbb45af7 req-e65c3b0d-d6f0-4db0-a3f9-29192991531b service nova] Creating event network-changed:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 14:59:32.850970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-59266236-740a-41f9-be61-3ec1fbb45af7 req-e65c3b0d-d6f0-4db0-a3f9-29192991531b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038542 May 18 14:59:32.855133 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 262/509] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:33.016642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:33.017743 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:33.025193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:33.025642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:33.026641 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:33.027188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:33.324231 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:33.336914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f9579f8c-4b51-46bd-8496-42a44a2a0916 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.324126 May 18 14:59:33.337522 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 248/510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:33 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:34.160046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1525091347"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:34.161291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:34.167628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.168085 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.168880 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.169319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.172976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:34.295716 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.network.security_group_api [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Adding security group 87209f13-ae86-4e34-8404-fc5ce5ccdd43 to port 13109190-8799-4d42-a04f-c61a209975be May 18 14:59:34.354044 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:34.354666 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:34.361409 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.361864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.362636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.363076 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.584421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:34.592388 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ae4c1fa9-9421-4367-9e94-79a806dc8dc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.242251 May 18 14:59:34.592992 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 249/511] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:34 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:34.758934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-08676a0a-0a04-44c6-8150-f439e26fba74 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/action" status: 202 len: 0 microversion: 2.1 time: 0.603602 May 18 14:59:34.759787 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 263/512] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:59:34 2022] POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:59:34.767978 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:34.768627 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:34.775615 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.775728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.776898 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.777333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.866321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-9a73b5d6-40a1-4a22-ba58-6ea2d5b797d9 req-30a6c469-cf50-425a-8826-eede4da71938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:34.883574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-9a73b5d6-40a1-4a22-ba58-6ea2d5b797d9 req-30a6c469-cf50-425a-8826-eede4da71938 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:34.884026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-9a73b5d6-40a1-4a22-ba58-6ea2d5b797d9 req-30a6c469-cf50-425a-8826-eede4da71938 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:34.896890 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-9a73b5d6-40a1-4a22-ba58-6ea2d5b797d9 req-30a6c469-cf50-425a-8826-eede4da71938 service nova] Creating event network-changed:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 14:59:34.901878 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-9a73b5d6-40a1-4a22-ba58-6ea2d5b797d9 req-30a6c469-cf50-425a-8826-eede4da71938 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039927 May 18 14:59:34.902499 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 264/513] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:59:34.947837 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:34.959237 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d9c24330-8aa0-4b53-b511-f58476689ddc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1760 microversion: 2.1 time: 0.195009 May 18 14:59:34.962593 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 250/514] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:34 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1760 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:35.610847 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:35.611551 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:35.618216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:35.618667 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:35.619434 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:35.619868 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:35.749260 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:35.757092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2dec3109-e583-4ea5-811f-911504d0a18b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.150971 May 18 14:59:35.757659 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 265/515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:35 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:36.774168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:36.774794 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:36.781431 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:36.781886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:36.782653 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:36.783178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:36.914538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:36.922481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4c5a49b6-bbcb-43c1-8326-95009682a30b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.152830 May 18 14:59:36.923058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 251/516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:36 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:37.943125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:37.943727 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:37.950124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:37.950565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:37.951311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:37.951739 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:38.079991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:38.088345 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3aaa37d8-db5c-4798-86dc-bb818ed0845d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.148989 May 18 14:59:38.088925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 266/517] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:37 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:39.105828 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:39.106446 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:39.113118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:39.113572 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:39.114916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:39.115355 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:39.244111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:39.251990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-22d7fcc5-6bc8-4c0c-9748-ecb48aec5bda tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1735 microversion: 2.1 time: 0.149969 May 18 14:59:39.252562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 252/518] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:39 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:40.268713 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:40.269323 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:40.275785 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.276231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.277019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.277457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.401975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:40.411432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e293c76c-a551-4e9d-a441-03b8a40f808b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1715 microversion: 2.1 time: 0.146585 May 18 14:59:40.412005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 267/519] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:40 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:40.511609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:40.512103 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:40.518967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.519417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.520177 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.520631 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.643693 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] HTTP exception thrown: Cannot 'detach_volume' instance 029fe182-8e95-49ca-88da-64523afce432 while it is in vm_state rescued May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Request method failure captured: May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments/9034a8f1-820f-49e8-8c8e-bcdad154d53f HTTP/1.1 May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjzVOTjOi0UiEostiqI8ORWnqTPMC1uMYluYnsq9j1moIP6jSgbXlZrFRGpt9SM4Md2HF7vcqiZefPkY1vDMbeaAEyZN5aEPjVeRqy6qRee47nQd0LqLnmb0hbFoGvoRer5ZUXDJhPBipl02_RJgfLVdDXmycR5z6fYJ-02NDeJs-A May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 84835592358a4e188df86896d6015647 May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 14:59:40.645339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/84835592358a4e188df86896d6015647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_84835592358a4e188df86896d6015647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168859250 May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 84835592358a4e188df86896d6015647 May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 2aa34e012c824754833a12ac66413aaf May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 14:59:40.646955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Cannot 'detach_volume' instance 029fe182-8e95-49ca-88da-64523afce432 while it is in vm_state rescued May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'server_id': '029fe182-8e95-49ca-88da-64523afce432', 'id': '9034a8f1-820f-49e8-8c8e-bcdad154d53f'} May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 029fe182-8e95-49ca-88da-64523afce432 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:59:40.647755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 029fe182-8e95-49ca-88da-64523afce432 while it is in vm_state rescued May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 029fe182-8e95-49ca-88da-64523afce432 while it is in vm_state rescued May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 14:59:40.649228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Returning 409 to user: Cannot 'detach_volume' instance 029fe182-8e95-49ca-88da-64523afce432 while it is in vm_state rescued {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:59:40.650829 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-df0a3daf-b013-4c49-a714-4024ec934303 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments/9034a8f1-820f-49e8-8c8e-bcdad154d53f" status: 409 len: 152 microversion: 2.1 time: 0.139243 May 18 14:59:40.650829 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 253/520] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 14:59:40 2022] DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments/9034a8f1-820f-49e8-8c8e-bcdad154d53f => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 14:59:40.655820 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:40.656350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:40.662817 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.663261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.664010 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.664438 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.737205 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8b2a585f-f4c5-4e78-8e64-063ac3884d63 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "POST /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/action" status: 202 len: 0 microversion: 2.1 time: 0.085113 May 18 14:59:40.737859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 268/521] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:59:40 2022] POST /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 14:59:40.746527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:40.747137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:40.753782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.754189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.755074 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:40.755483 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:40.969378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:40.978051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4cb9fabe-efff-420a-b987-5f22c6985160 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1723 microversion: 2.1 time: 0.235318 May 18 14:59:40.978623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 254/522] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:40 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 14:59:41.996936 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:41.997673 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:42.003821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:42.004275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:42.005079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:42.005518 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:42.131916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:42.139821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f0934df1-fda1-4502-815a-64aa2d9dadc5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1723 microversion: 2.1 time: 0.147711 May 18 14:59:42.140393 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 269/523] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:41 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:43.157031 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:43.157612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:43.160071 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=48 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:43.166276 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:43.166761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:43.167533 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:43.167973 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:43.300277 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:43.308381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6d25cabd-66d0-431c-a974-c84821a47002 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1723 microversion: 2.1 time: 0.155372 May 18 14:59:43.308987 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 255/524] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:43 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:44.325337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:44.325904 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:44.333214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.333675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.334442 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.334906 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.466336 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:44.474156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c7260de3-d74b-4842-8716-cb5b86222a61 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1729 microversion: 2.1 time: 0.152781 May 18 14:59:44.474712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 270/525] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:44 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:44.490367 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:44.490866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:44.497366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.497818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.498584 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.499022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.576294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:44.576546 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ac8f400f-aa8c-4ac2-aec6-8a5c8598360c tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090050 May 18 14:59:44.577205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 256/526] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 14:59:44 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:44.577712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:44.583917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.584369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.585165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.585600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.616432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ae3e9521-d176-41ed-afe5-e5942a73c050 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments/6da8b590-47ff-4d94-a008-42d48509facb" status: 200 len: 194 microversion: 2.20 time: 0.045506 May 18 14:59:44.617058 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 271/527] 10.222.0.59 () {60 vars in 1453 bytes} [Wed May 18 14:59:44 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments/6da8b590-47ff-4d94-a008-42d48509facb => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 14:59:44.679965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:44.680550 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:44.686671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.687200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.688038 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.688546 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.771419 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lazy-loading 'services' on Instance uuid 5cf9b2c2-1694-4695-8c54-940340452792 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:59:44.885205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-854fafc3-ee51-4278-a63e-f25a4f6b52b4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments/6da8b590-47ff-4d94-a008-42d48509facb" status: 202 len: 0 microversion: 2.20 time: 0.209812 May 18 14:59:44.885820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 257/528] 10.222.0.59 () {60 vars in 1456 bytes} [Wed May 18 14:59:44 2022] DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments/6da8b590-47ff-4d94-a008-42d48509facb => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 14:59:44.894425 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:44.896073 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:44.902539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.903165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.903982 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:44.904533 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:44.939311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-49f57008-c60e-4514-bb87-e0b026bfe147 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049034 May 18 14:59:44.939885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 272/529] 10.222.0.59 () {60 vars in 1342 bytes} [Wed May 18 14:59:44 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:59:45.459447 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-a63f56b9-6d18-4b7a-a5f7-8f3219d1f504 req-24dceae6-297b-4bcb-9900-aef1f314c89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029fe182-8e95-49ca-88da-64523afce432", "tag": "b2e8b9ad-823b-4ddb-820c-d6a26d7edf96"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:45.468399 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-a63f56b9-6d18-4b7a-a5f7-8f3219d1f504 req-24dceae6-297b-4bcb-9900-aef1f314c89f service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:45.468877 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-a63f56b9-6d18-4b7a-a5f7-8f3219d1f504 req-24dceae6-297b-4bcb-9900-aef1f314c89f service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:45.492958 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-a63f56b9-6d18-4b7a-a5f7-8f3219d1f504 req-24dceae6-297b-4bcb-9900-aef1f314c89f service nova] Creating event network-changed:b2e8b9ad-823b-4ddb-820c-d6a26d7edf96 for instance 029fe182-8e95-49ca-88da-64523afce432 on hv-cinder-83998 May 18 14:59:45.499047 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-a63f56b9-6d18-4b7a-a5f7-8f3219d1f504 req-24dceae6-297b-4bcb-9900-aef1f314c89f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043725 May 18 14:59:45.499655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 258/530] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:45.951689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:45.952693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:45.959486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:45.960173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:45.960975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:45.961600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:45.995066 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-94a90380-d969-477a-a71d-6bb5fe00e73a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046710 May 18 14:59:45.999684 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 273/531] 10.222.0.59 () {60 vars in 1342 bytes} [Wed May 18 14:59:45 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 14:59:47.008779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:47.009819 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:47.015983 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.016436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.017225 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.017665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.045162 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4809fbc7-d931-4741-aa4f-a043e3eb0fa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041788 May 18 14:59:47.045642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 259/532] 10.222.0.59 () {60 vars in 1342 bytes} [Wed May 18 14:59:47 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:47.102786 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:47.103311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:47.109709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.110164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.110933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.111373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.136562 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 14:59:47.209759 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-857bb025-bada-459e-884f-3565acdc9f9a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 204 len: 0 microversion: 2.20 time: 0.110926 May 18 14:59:47.210472 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 274/533] 10.222.0.59 () {60 vars in 1279 bytes} [Wed May 18 14:59:47 2022] DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 14:59:47.218973 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:47.219588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:47.226088 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.226539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.227303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.227744 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.362594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:47.371099 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:47.372630 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:47.373793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-81681794-6798-4dde-a2dc-60f9a15c4e24 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.158880 May 18 14:59:47.374355 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 260/534] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:47 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 14:59:47.513081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-109cec4c-b6c8-4f24-b300-1fa70035afe5 req-3beb65b8-76bf-45fb-a3c9-ccb2f6cb7981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029fe182-8e95-49ca-88da-64523afce432", "tag": "b2e8b9ad-823b-4ddb-820c-d6a26d7edf96"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:47.521470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-109cec4c-b6c8-4f24-b300-1fa70035afe5 req-3beb65b8-76bf-45fb-a3c9-ccb2f6cb7981 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:47.521905 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-109cec4c-b6c8-4f24-b300-1fa70035afe5 req-3beb65b8-76bf-45fb-a3c9-ccb2f6cb7981 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:47.532289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-109cec4c-b6c8-4f24-b300-1fa70035afe5 req-3beb65b8-76bf-45fb-a3c9-ccb2f6cb7981 service nova] Creating event network-changed:b2e8b9ad-823b-4ddb-820c-d6a26d7edf96 for instance 029fe182-8e95-49ca-88da-64523afce432 on hv-cinder-83998 May 18 14:59:47.537589 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-109cec4c-b6c8-4f24-b300-1fa70035afe5 req-3beb65b8-76bf-45fb-a3c9-ccb2f6cb7981 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028560 May 18 14:59:47.538139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 275/535] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 14:59:48.392812 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:48.393451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:48.399820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:48.400261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:48.401031 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:48.401461 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:48.527449 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:48.535180 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:48.536734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:48.537868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b8ad2ca5-02a1-4cd9-901e-a147e441baef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.149029 May 18 14:59:48.538415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 261/536] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:48 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:49.557826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:49.558531 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:49.564676 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:49.565570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:49.565901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:49.566330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:49.764465 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:49.773468 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:49.775138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:49.776490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6788d0f2-3bad-4357-862c-16923a39616a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 200 len: 1722 microversion: 2.20 time: 0.224319 May 18 14:59:49.777524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 276/537] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:49 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:50.094744 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-4cf2b7d5-0664-47d9-9c8e-eeadccc5572f req-7fc07621-e64f-4250-8381-29dff1cc68a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf9b2c2-1694-4695-8c54-940340452792", "name": "network-vif-deleted", "tag": "4b7b091c-ade3-422f-a228-9a575395a54b"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:50.104472 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-4cf2b7d5-0664-47d9-9c8e-eeadccc5572f req-7fc07621-e64f-4250-8381-29dff1cc68a0 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:50.105049 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-4cf2b7d5-0664-47d9-9c8e-eeadccc5572f req-7fc07621-e64f-4250-8381-29dff1cc68a0 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:50.117000 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-4cf2b7d5-0664-47d9-9c8e-eeadccc5572f req-7fc07621-e64f-4250-8381-29dff1cc68a0 service nova] Creating event network-vif-deleted:4b7b091c-ade3-422f-a228-9a575395a54b for instance 5cf9b2c2-1694-4695-8c54-940340452792 on hv-cinder-83998 May 18 14:59:50.121735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-4cf2b7d5-0664-47d9-9c8e-eeadccc5572f req-7fc07621-e64f-4250-8381-29dff1cc68a0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030808 May 18 14:59:50.125332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 262/538] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:50.795981 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:50.797115 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:50.805409 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:50.805861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:50.806784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:50.807227 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:50.823625 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] HTTP exception thrown: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Request method failure captured: May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 HTTP/1.1 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjwcxC48mOuVnDFLntKeAestmjUyTrXmQ7pjI_7S8QLBTdGG30lwqKPKLoqfybCSAWBPPAuN4b_ePB3hHYZN2FrXWg8CdbQenA8C_Ksti4eG0zxm-pWiMUkQleiDpc_AttdsF_7EnkqgjL0MiW6q8_6xiFQ0zFKIag9I_sJkE4RGj8 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Openstack-Nova-Api-Version: 2.20 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 14:59:50.825401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-351182998 May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 25784e3193b047ecaa6788bd79611f3f May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 14:59:50.827023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '5cf9b2c2-1694-4695-8c54-940340452792'} May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 14:59:50.827944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 14:59:50.829457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 14:59:50.830751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Returning 404 to user: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 14:59:50.831470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-14c80131-81aa-469e-8648-9bd352b21e3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 404 len: 111 microversion: 2.20 time: 0.040047 May 18 14:59:50.832131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 277/539] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:50 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 14:59:50.841787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b38c4093-8599-4d6d-a4d0-df1456a185c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '.version_select at 0x7fa8a0a90040>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:50.862123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b38c4093-8599-4d6d-a4d0-df1456a185c6 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433289601" status: 204 len: 0 microversion: 2.20 time: 0.024575 May 18 14:59:50.862706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 263/540] 10.222.0.59 () {60 vars in 1261 bytes} [Wed May 18 14:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433289601 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 14:59:51.796869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-34004afa-3922-4b5b-a000-6522eaec2ec5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'create', calling method: .version_select at 0x7fa8a0b88ca0>, body: {"keypair": {"name": "tempest-keypair-1544099451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUvVnAe2t46Nexma3u2xP64lm3V3FjoCkmPr472CmwPm4shD9BA/h714+AxupjvsY1O1MObCZO3foyTqEJSAV/E/YB+xKsCzR2ZmcqPh0//WWm55QJD7D3VUci27Y7kmg=="}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:51.811968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-34004afa-3922-4b5b-a000-6522eaec2ec5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:59:51.815728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-34004afa-3922-4b5b-a000-6522eaec2ec5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for user 25784e3193b047ecaa6788bd79611f3f and project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:59:51.837018 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-34004afa-3922-4b5b-a000-6522eaec2ec5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044022 May 18 14:59:51.837608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 278/541] 10.222.0.59 () {62 vars in 1199 bytes} [Wed May 18 14:59:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 18 14:59:53.181288 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-868723700", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0410fe00-b11d-4309-b353-5cb8e97484be"}], "security_groups": [{"name": "tempest-securitygroup--272927352"}], "key_name": "tempest-keypair-1544099451", "user_data": "}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:53.287187 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] validate_networks() for [('0410fe00-b11d-4309-b353-5cb8e97484be', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 14:59:53.644166 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 14:59:53.644604 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 14:59:53.645099 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 14:59:53.646258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 14:59:53.646744 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 14:59:53.655660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:53.656104 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:53.656957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:53.657393 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:53.674225 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 14:59:53.678384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Getting quotas for user 25784e3193b047ecaa6788bd79611f3f and project 9c46dc2b21d34158bf2a7eb0e39c06a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 14:59:53.689109 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 14:59:53.691412 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 14:59:53.737673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-dcaf28a8-07c0-4878-b85b-43b4d9287667 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.562134 May 18 14:59:53.738322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 264/542] 10.222.0.59 () {62 vars in 1187 bytes} [Wed May 18 14:59:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 14:59:53.749020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c336eee8-3c1a-4a09-9fd2-7d52fa321cd5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:53.749637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c336eee8-3c1a-4a09-9fd2-7d52fa321cd5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:53.803538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c336eee8-3c1a-4a09-9fd2-7d52fa321cd5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:53.810753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c336eee8-3c1a-4a09-9fd2-7d52fa321cd5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:53.812319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c336eee8-3c1a-4a09-9fd2-7d52fa321cd5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:53.813463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c336eee8-3c1a-4a09-9fd2-7d52fa321cd5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1281 microversion: 2.20 time: 0.068966 May 18 14:59:53.814095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 279/543] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:53 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:54.831291 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:54.832562 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:54.839637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:54.840101 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:54.840890 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:54.841324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:54.912695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:54.921111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:54.922615 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:54.924254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9a837792-5db4-4401-8474-da8855335be5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1351 microversion: 2.20 time: 0.096617 May 18 14:59:54.924836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 265/544] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:54 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:55.943383 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:55.943995 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:55.950452 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:55.950902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:55.951672 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:55.952108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:56.376782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:56.387135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:56.388693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:56.389980 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6d149ee6-9b85-4873-8709-abe7054fd24a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.450837 May 18 14:59:56.391835 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 280/545] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:55 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:56.597170 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-fa7295f2-a68c-41d0-bbde-93891250d35a req-47d2ca0e-7e74-4893-b180-0c844ce0ff73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:56.607358 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-fa7295f2-a68c-41d0-bbde-93891250d35a req-47d2ca0e-7e74-4893-b180-0c844ce0ff73 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:56.608291 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-fa7295f2-a68c-41d0-bbde-93891250d35a req-47d2ca0e-7e74-4893-b180-0c844ce0ff73 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:56.628650 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-fa7295f2-a68c-41d0-bbde-93891250d35a req-47d2ca0e-7e74-4893-b180-0c844ce0ff73 service nova] Creating event network-changed:d65953ed-9d4b-4ed8-bdb3-b52cc90c0217 for instance b9394fe1-b670-4e51-b247-71558d6f56ca on hv-cinder-83998 May 18 14:59:56.633572 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-fa7295f2-a68c-41d0-bbde-93891250d35a req-47d2ca0e-7e74-4893-b180-0c844ce0ff73 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040417 May 18 14:59:56.634178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 266/546] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 14:59:57.078526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:57.079631 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:57.086802 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:57.087245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:57.088054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:57.088529 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:57.147867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:57.215468 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lazy-loading 'services' on Instance uuid ee7efce9-bda4-4d05-a813-164f962babab {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 14:59:57.324929 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b9854f79-8929-4243-be4f-1f34c1a2f738 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-volume_attachments/f93b8c64-e417-4063-9672-99dd188f2816" status: 202 len: 0 microversion: 2.1 time: 0.250240 May 18 14:59:57.325808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 281/547] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 14:59:57 2022] DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-volume_attachments/f93b8c64-e417-4063-9672-99dd188f2816 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 14:59:57.408971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:57.409594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:57.415808 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:57.416250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:57.417021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:57.417491 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:57.421396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:57.550443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:57.559130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:57.560673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:57.561773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a488fa6d-2c14-4d7a-aae8-9b0cd7a86732 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.157113 May 18 14:59:57.562334 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 267/548] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:57 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:58.580905 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:58.581631 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:58.588406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:58.588887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:58.589649 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:58.590087 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:58.786771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:58.794660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:58.796164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:58.797287 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-38855b9d-86ab-4541-b16a-3a9e739056a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.221111 May 18 14:59:58.797839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 282/549] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:58 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 14:59:59.485661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-123a4d58-2712-4e14-aeeb-baaecd770761 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 14:59:59.492080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-123a4d58-2712-4e14-aeeb-baaecd770761 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:59.492545 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-123a4d58-2712-4e14-aeeb-baaecd770761 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:59.514074 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-123a4d58-2712-4e14-aeeb-baaecd770761 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Going to try to stop instance {{(pid=123865) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 18 14:59:59.555836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-123a4d58-2712-4e14-aeeb-baaecd770761 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action" status: 202 len: 0 microversion: 2.1 time: 0.073826 May 18 14:59:59.556508 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 268/550] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 14:59:59 2022] POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 14:59:59.564470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:59.565126 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:59.571680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:59.572133 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:59.573005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:59.573487 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:59.711005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:59.718753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-46bf1e5c-a80e-49f7-b34a-27b7dceffe42 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.158139 May 18 14:59:59.719331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 283/551] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 14:59:59 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 14:59:59.815915 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 14:59:59.816525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 14:59:59.822768 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:59.823218 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:59.823979 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 14:59:59.824421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 14:59:59.953084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:59.962588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:59.964841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 14:59:59.966284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-83cdef63-b233-47d7-ac3a-9390242bba1a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.154745 May 18 14:59:59.966858 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 269/552] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 14:59:59 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:00:00.735868 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:00.736484 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:00.738874 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:00.744670 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:00.745124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:00.745884 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:00.746323 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:00.875782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:00.883222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0ec744ec-e5d7-482e-b888-50b6eeb703a8 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.151203 May 18 15:00:00.883782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 284/553] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:00 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:00.984278 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:00.984907 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:00.992016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:00.992404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:00.993200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:00.993632 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:01.123035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:01.131246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:01.132964 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:01.134112 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9c395816-9f3c-4356-b3de-d57fb9a1aa18 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.153705 May 18 15:00:01.134724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 270/554] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:00 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:00:01.900488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:01.901074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:01.907552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:01.908002 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:01.908794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:01.909239 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:02.045232 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:02.055249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3e8c65ff-c2d5-4973-8857-649560e97387 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.158494 May 18 15:00:02.056131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 285/555] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:01 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:02.151974 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:02.152504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:02.159001 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:02.159451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:02.160219 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:02.160680 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:02.289814 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:02.297709 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:02.299233 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:02.300336 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3f9d7a51-e56c-47ea-8cb6-87325d9915b3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.152364 May 18 15:00:02.300950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 271/556] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:02 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:00:03.073587 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:03.074099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:03.080558 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:03.081034 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:03.081794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:03.082230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:03.215403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:03.223172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-63aec471-e137-4bf9-9907-04b2321f56c1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.153499 May 18 15:00:03.224222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 286/557] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:03 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:00:03.319203 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:03.319850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:03.326438 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:03.326820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:03.327573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:03.328003 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:03.465425 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:03.473366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:03.475463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:03.476568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b50fc273-e264-4330-9dbf-90deb35af1ca tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.161546 May 18 15:00:03.477362 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 272/558] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:03 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:00:03.566614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-50cad256-f01a-43c4-abb5-432ec4ff797c req-aece5200-f246-4adb-bfbb-16a8dc5c0110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "name": "network-vif-plugged", "status": "completed", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:03.575016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-50cad256-f01a-43c4-abb5-432ec4ff797c req-aece5200-f246-4adb-bfbb-16a8dc5c0110 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:03.575461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-50cad256-f01a-43c4-abb5-432ec4ff797c req-aece5200-f246-4adb-bfbb-16a8dc5c0110 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:03.588418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-50cad256-f01a-43c4-abb5-432ec4ff797c req-aece5200-f246-4adb-bfbb-16a8dc5c0110 service nova] Creating event network-vif-plugged:d65953ed-9d4b-4ed8-bdb3-b52cc90c0217 for instance b9394fe1-b670-4e51-b247-71558d6f56ca on hv-cinder-83998 May 18 15:00:03.593148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-50cad256-f01a-43c4-abb5-432ec4ff797c req-aece5200-f246-4adb-bfbb-16a8dc5c0110 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 May 18 15:00:03.593757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 287/559] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:00:04.241441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:04.242089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:04.244152 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:04.244936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=6 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:04.250734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:04.251189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:04.251954 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:04.252393 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:04.382532 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:04.389942 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f2783fba-d91b-46fe-9114-6887dda928ac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.152350 May 18 15:00:04.390499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 273/560] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:04 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:04.492121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:04.497385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:04.498087 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:04.505498 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:04.506515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:04.507286 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:04.507709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:04.637850 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:04.645634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:04.647147 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:04.648356 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3d936fa1-47d1-4cce-836d-5a69aa9f3932 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.157272 May 18 15:00:04.648952 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 288/561] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:04 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:00:05.407444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:05.408059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:05.415156 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:05.415612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:05.416375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:05.416843 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:05.541911 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:05.549310 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-736b444f-9ca4-40f7-b449-3f1ec182e0ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.145801 May 18 15:00:05.549878 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 274/562] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:05 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:05.666351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:05.666969 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:05.673719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:05.674176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:05.674954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:05.675394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:05.810422 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:05.818891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:05.820414 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:05.821548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-625c7515-d718-4bcd-ab90-16af11f7d3a1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1406 microversion: 2.20 time: 0.159121 May 18 15:00:05.822114 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 289/563] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:05 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:00:06.566119 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:06.566644 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:06.573639 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:06.574089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:06.574846 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:06.575288 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:06.704253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:06.712329 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-68b182f5-2196-4d00-b7c4-0f9c1e1e0dd5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.150135 May 18 15:00:06.712931 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 275/564] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:06 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:06.839748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:06.840331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:06.846976 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:06.847429 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:06.848220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:06.848683 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:06.977279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:06.985117 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:06.986627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:06.987769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-33a7f200-b89d-430f-98df-c93cd0481322 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1597 microversion: 2.20 time: 0.151976 May 18 15:00:06.988330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 290/565] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:06 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1597 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:00:07.004678 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:07.005174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:07.011759 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.012231 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.013004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.013434 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.060500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:07.061526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:07.067441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.067887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.069171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.069609 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.094296 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d92609ce-d2bd-46ab-9c91-243c97e6cfa0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093438 May 18 15:00:07.094897 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 276/566] 10.222.0.59 () {60 vars in 1315 bytes} [Wed May 18 15:00:06 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 15:00:07.149316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0ab10433-09d5-4b4a-9333-6412f5138ca0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/action" status: 202 len: 0 microversion: 2.1 time: 0.092290 May 18 15:00:07.153757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 291/567] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 15:00:07 2022] POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 15:00:07.160841 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:07.161488 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:07.168104 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.168538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.169357 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.169996 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.499183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:07.507726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-64cb6f97-13b5-466e-ab26-b1709a168e09 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1752 microversion: 2.1 time: 0.351524 May 18 15:00:07.508303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 277/568] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:07 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1752 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:07.729680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:07.730378 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:07.736663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.737108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:07.737898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:07.738333 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:08.068396 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:08.075823 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d3b900ff-a846-4843-ac59-baee063788e9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.350506 May 18 15:00:08.076384 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 292/569] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:07 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:08.525790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:08.526366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:08.532764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:08.533230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:08.533985 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:08.534412 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:08.761234 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:08.769077 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-653b3c41-67e4-45ce-8ad4-a88f8b5a8456 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1752 microversion: 2.1 time: 0.247819 May 18 15:00:08.769863 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 278/570] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:08 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:08.901713 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-8e074471-17dc-46d7-9216-98d68ccb87a1 req-7936ca2b-3198-4303-b1d9-7379181553b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:08.910128 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-8e074471-17dc-46d7-9216-98d68ccb87a1 req-7936ca2b-3198-4303-b1d9-7379181553b8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:08.910574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-8e074471-17dc-46d7-9216-98d68ccb87a1 req-7936ca2b-3198-4303-b1d9-7379181553b8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:08.921417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-8e074471-17dc-46d7-9216-98d68ccb87a1 req-7936ca2b-3198-4303-b1d9-7379181553b8 service nova] Creating event network-changed:d65953ed-9d4b-4ed8-bdb3-b52cc90c0217 for instance b9394fe1-b670-4e51-b247-71558d6f56ca on hv-cinder-83998 May 18 15:00:08.926486 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-8e074471-17dc-46d7-9216-98d68ccb87a1 req-7936ca2b-3198-4303-b1d9-7379181553b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028482 May 18 15:00:08.927339 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 293/571] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:09.095329 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:09.095954 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:09.103390 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:09.103904 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:09.105737 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:09.105958 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:09.326797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:09.334823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8b1abcb3-b8ec-46d3-a430-21bafb869517 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1677 microversion: 2.1 time: 0.245352 May 18 15:00:09.340676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 279/572] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:09 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:09.788112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:09.788865 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:09.795381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:09.795832 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:09.796956 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:09.797104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:09.952789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:09.961891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3bc827f0-4165-41a7-a8cd-9d09770ce5a0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.178753 May 18 15:00:09.962466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 294/573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:09 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:00:10.351779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:10.352391 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:10.359021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.359474 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:10.360261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.360725 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:10.487453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:10.495311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ec9e1d5c-e4fc-48b6-aad3-a877f1e33eaa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1654 microversion: 2.1 time: 0.147445 May 18 15:00:10.495884 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 280/574] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:10 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:10.511846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7cc6b0f6-d00b-4187-9bd5-5ab9b4966298 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:10.517902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7cc6b0f6-d00b-4187-9bd5-5ab9b4966298 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.518350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7cc6b0f6-d00b-4187-9bd5-5ab9b4966298 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:10.539511 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7cc6b0f6-d00b-4187-9bd5-5ab9b4966298 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Going to try to start instance {{(pid=123864) start /opt/stack/nova/nova/compute/api.py:2730}} May 18 15:00:10.579862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7cc6b0f6-d00b-4187-9bd5-5ab9b4966298 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action" status: 202 len: 0 microversion: 2.1 time: 0.071708 May 18 15:00:10.580471 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 295/575] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 15:00:10 2022] POST /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 15:00:10.588551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:10.589191 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:10.595076 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.595527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:10.596301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.596767 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:10.742266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:10.749739 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8f21d7f2-c6ba-48af-9d32-71535884a136 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1663 microversion: 2.1 time: 0.165041 May 18 15:00:10.750308 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 281/576] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:10 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:10.981129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:10.981899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:10.988161 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.988641 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:10.989503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:10.989892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:11.258908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:11.262419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:11.268655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3cdac584-88f0-46b5-be62-590a5a457bee tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.292269 May 18 15:00:11.278658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 296/577] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:10 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:11.767265 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:11.767918 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:11.775058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:11.775509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:11.776275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:11.776740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:11.902915 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:11.910404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f9627156-6b8d-4d54-ba6e-e7863aa0c098 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1663 microversion: 2.1 time: 0.147038 May 18 15:00:11.910970 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 282/578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:11 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:12.286784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:12.287361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:12.294605 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:12.295047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:12.295815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:12.296246 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:12.443700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:12.453148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-91a8d0f9-41f3-4c71-aec8-862b7d408e72 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.170563 May 18 15:00:12.453799 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 297/579] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:12 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:12.928709 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:12.929323 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:12.935827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:12.936282 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:12.937085 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:12.937528 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:12.941429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:13.066537 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:13.073971 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ac5e4e10-210d-48e8-9e05-9ae6d7318b2f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1667 microversion: 2.1 time: 0.149960 May 18 15:00:13.074538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 283/580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:12 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:13.471282 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:13.471895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:13.478963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:13.479413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:13.480182 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:13.480646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:13.623701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:13.631615 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7c0993b5-a445-416b-9e37-44b04db2fccf tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.164259 May 18 15:00:13.632217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 298/581] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:13 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:14.649178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:14.649872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:14.652281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:14.657761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:14.658205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:14.658959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:14.659388 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:14.797617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:14.805847 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d9a376b7-543a-4c6e-ae13-8c0825b6d4ca tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.161063 May 18 15:00:14.806417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 284/582] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:14 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:15.822825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:15.823436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:15.829951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:15.830391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:15.831146 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:15.831576 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:15.973910 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:15.982364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d3b8a049-fc3b-40d4-ba1c-9ca6a4f778fd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.163481 May 18 15:00:15.982919 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 299/583] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:15 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:16.999478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:17.000081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:17.006527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:17.006969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:17.007715 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:17.008141 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:17.149886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:17.160483 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-97181c41-ccaa-4391-bea2-7a7d4aa73ae4 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.164587 May 18 15:00:17.161238 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 285/584] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:16 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:18.180650 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:18.181276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:18.187842 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:18.188276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:18.189221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:18.191566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:18.348688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:18.357664 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5748401c-1741-4694-9098-5d3eed6ce937 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.181257 May 18 15:00:18.358233 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 300/585] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:18 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:19.374607 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:19.375160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:19.381759 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:19.382204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:19.382952 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:19.383383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:19.525436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:19.533256 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6f2fa832-4572-4bf9-a294-b1f4b0b46e8c tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.162595 May 18 15:00:19.533815 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 286/586] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:19 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:20.554338 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:20.555403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:20.564189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:20.564663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:20.565433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:20.565926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:20.722081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:20.733063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d43a730a-ff29-45c6-8770-cdcf75dfcb14 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.185387 May 18 15:00:20.734552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 301/587] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:20 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:21.754221 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:21.754880 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:21.763755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:21.764204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:21.765002 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:21.765442 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:21.918361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:21.926302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e94cf38a-98bb-4ade-812c-32c77fa9b988 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.177666 May 18 15:00:21.926866 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 287/588] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:21 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:22.944129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:22.944825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:22.950858 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:22.951311 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:22.952084 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:22.952522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:23.093257 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:23.101691 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-70ca1991-d957-4b95-8041-c603cae8bfa8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.161670 May 18 15:00:23.102258 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 302/589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:22 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:24.119666 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:24.120280 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:24.126676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:24.127144 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:24.127895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:24.128322 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:24.275916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:24.284006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2e940406-c38f-4ba0-ac8c-500c262cbd5f tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1757 microversion: 2.1 time: 0.168246 May 18 15:00:24.284575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 288/590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:24 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:24.580964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:24.581476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:24.587960 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:24.588412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:24.589217 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:24.589656 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:24.669600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lazy-loading 'services' on Instance uuid 029fe182-8e95-49ca-88da-64523afce432 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:00:24.740283 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d8a66a71-3a09-4981-9349-d2f81eef9905 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments/9034a8f1-820f-49e8-8c8e-bcdad154d53f" status: 202 len: 0 microversion: 2.1 time: 0.163100 May 18 15:00:24.740897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 303/591] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:00:24 2022] DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments/9034a8f1-820f-49e8-8c8e-bcdad154d53f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:00:24.749052 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:24.750127 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:24.756564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:24.757113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:24.757870 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:24.758302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:24.786641 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c33c2167-9568-48af-b758-a545e51f4324 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041369 May 18 15:00:24.787726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 289/592] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:00:24 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:25.301810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:25.302500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:25.308975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:25.309429 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:25.310194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:25.310631 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:25.450748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:25.458700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-38f33905-1ea2-4a49-95d6-8e320f961a51 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1760 microversion: 2.1 time: 0.161186 May 18 15:00:25.459293 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 304/593] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:25 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:25.798721 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:25.799690 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:25.806968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:25.807426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:25.808193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:25.808667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:25.836496 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-087d7feb-b7cc-468b-9fd1-42d36b39923f tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 May 18 15:00:25.837080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 290/594] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:00:25 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:26.847397 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:26.848404 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:26.854944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:26.855385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:26.856136 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:26.856561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:26.884180 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-91a1cccb-bdfa-4ee8-ad99-5637dac928f5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040785 May 18 15:00:26.884746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 305/595] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:00:26 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:00:26.953645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:26.954149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:26.960817 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:26.961267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:26.962036 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:26.962474 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:26.987044 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:00:27.060344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d461295d-6691-4a91-a4b2-20c6ed135f9d tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 204 len: 0 microversion: 2.1 time: 0.110117 May 18 15:00:27.060892 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 291/596] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:00:26 2022] DELETE /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:00:27.069560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:27.070173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:27.076280 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:27.076768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:27.077532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:27.078009 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:27.204951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:27.212903 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-22b32939-5158-4060-b2fa-7911e91d2d08 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1689 microversion: 2.1 time: 0.147532 May 18 15:00:27.213478 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 306/597] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:27 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:28.231360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:28.232089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:28.238536 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:28.238981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:28.239735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:28.240824 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:28.371471 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:28.379016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d0e5de4d-bc9c-47c5-a757-9ef5629f5933 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1689 microversion: 2.1 time: 0.152307 May 18 15:00:28.379588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 292/598] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:28 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:29.395132 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:29.395754 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:29.402453 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:29.402904 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:29.403673 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:29.404116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:29.530135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:29.537979 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8ffd864c-00ff-4892-9bbe-06437e1249fc tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1689 microversion: 2.1 time: 0.146704 May 18 15:00:29.538552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 307/599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:29 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:30.556010 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:30.556538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:30.563043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:30.563494 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:30.564248 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:30.564718 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:30.698699 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:30.706131 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cf25b016-1729-4b4a-a1fa-d88ff7a0a534 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1689 microversion: 2.1 time: 0.154911 May 18 15:00:30.706686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 293/600] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:30 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:00:31.710856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-7cb30ada-c5d0-40c5-93ec-b8aaa7710542 req-8b436d7d-03d6-4510-af29-c570acddbb68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029fe182-8e95-49ca-88da-64523afce432", "name": "network-vif-deleted", "tag": "b2e8b9ad-823b-4ddb-820c-d6a26d7edf96"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:31.717203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=48 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:31.723373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-7cb30ada-c5d0-40c5-93ec-b8aaa7710542 req-8b436d7d-03d6-4510-af29-c570acddbb68 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:31.724675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-7cb30ada-c5d0-40c5-93ec-b8aaa7710542 req-8b436d7d-03d6-4510-af29-c570acddbb68 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:31.726297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:31.727706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:31.734479 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:31.735029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:31.735882 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:31.736398 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:31.738492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-7cb30ada-c5d0-40c5-93ec-b8aaa7710542 req-8b436d7d-03d6-4510-af29-c570acddbb68 service nova] Creating event network-vif-deleted:b2e8b9ad-823b-4ddb-820c-d6a26d7edf96 for instance 029fe182-8e95-49ca-88da-64523afce432 on hv-cinder-83998 May 18 15:00:31.744275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-7cb30ada-c5d0-40c5-93ec-b8aaa7710542 req-8b436d7d-03d6-4510-af29-c570acddbb68 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036904 May 18 15:00:31.745095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 308/601] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:31.807736 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:31.816042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2276387d-b4e9-48ed-9c7b-813ba3d38e93 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 200 len: 1621 microversion: 2.1 time: 0.095797 May 18 15:00:31.822728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 294/602] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:31 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 1621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:32.834295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:32.835122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 029fe182-8e95-49ca-88da-64523afce432] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:32.842093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:32.842581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:32.843349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:32.843792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:32.857798 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] HTTP exception thrown: Instance 029fe182-8e95-49ca-88da-64523afce432 could not be found. May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Request method failure captured: May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 HTTP/1.1 May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjzVOTjOi0UiEostiqI8ORWnqTPMC1uMYluYnsq9j1moIP6jSgbXlZrFRGpt9SM4Md2HF7vcqiZefPkY1vDMbeaAEyZN5aEPjVeRqy6qRee47nQd0LqLnmb0hbFoGvoRer5ZUXDJhPBipl02_RJgfLVdDXmycR5z6fYJ-02NDeJs-A May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 84835592358a4e188df86896d6015647 May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:00:32.859412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/84835592358a4e188df86896d6015647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_84835592358a4e188df86896d6015647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 84835592358a4e188df86896d6015647 May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 2aa34e012c824754833a12ac66413aaf May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 029fe182-8e95-49ca-88da-64523afce432 could not be found. May 18 15:00:32.861048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '029fe182-8e95-49ca-88da-64523afce432'} May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029fe182-8e95-49ca-88da-64523afce432 could not be found. May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:00:32.862150 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029fe182-8e95-49ca-88da-64523afce432 could not be found. May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029fe182-8e95-49ca-88da-64523afce432 could not be found. May 18 15:00:32.863666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:32.865619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Returning 404 to user: Instance 029fe182-8e95-49ca-88da-64523afce432 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:00:32.865619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9291a1b2-4462-4da7-afb0-8467556cadc8 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432" status: 404 len: 111 microversion: 2.1 time: 0.031420 May 18 15:00:32.865619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 309/603] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:32 2022] GET /compute/v2.1/servers/029fe182-8e95-49ca-88da-64523afce432 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:00:32.869810 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e685899a-eb15-4a33-9ad9-cd368920e310 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '.version_select at 0x7fa8a0916160>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:32.888715 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e685899a-eb15-4a33-9ad9-cd368920e310 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655765253" status: 202 len: 0 microversion: 2.1 time: 0.022600 May 18 15:00:32.889269 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 295/604] 10.222.0.59 () {58 vars in 1220 bytes} [Wed May 18 15:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655765253 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:00:35.762805 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:35.763305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:35.769638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:35.770082 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:35.770836 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:35.771940 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:35.795971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:00:35.868006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7e7d82c6-6bd4-484f-9ac3-9eaa8c9ccbd7 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 204 len: 0 microversion: 2.1 time: 0.108882 May 18 15:00:35.868650 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 310/605] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:00:35 2022] DELETE /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:00:35.877442 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:35.878072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:35.885956 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:35.886412 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:35.887182 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:35.887620 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:36.014391 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:36.021884 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-56a3f901-f641-4c7a-ac78-39a3aa06f801 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1508 microversion: 2.1 time: 0.148557 May 18 15:00:36.022521 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 296/606] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:35 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:37.039418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:37.040124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:37.046667 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:37.047122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:37.047887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:37.048325 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:37.175418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:37.183100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a0303bc2-ddda-467d-9b79-d11bacb02efb tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1508 microversion: 2.1 time: 0.147866 May 18 15:00:37.183660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 311/607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:37 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:38.200113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:38.200790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:38.207476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:38.207933 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:38.208760 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:38.209201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:38.449053 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:38.456504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a19d4e5e-0a33-4434-9d91-161ae02be121 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1508 microversion: 2.1 time: 0.260253 May 18 15:00:38.457017 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 297/608] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:38 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:39.309413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-f81c5b5f-d262-4127-835b-6234ceba3fbe req-740dc2bb-6054-4f0d-88e3-f40bbf8755d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f6cf5f-5077-4b01-9a99-ffe0f7a20a17", "name": "network-vif-deleted", "tag": "be1a0b48-9f78-477a-a06b-50518f954982"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:39.317901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f81c5b5f-d262-4127-835b-6234ceba3fbe req-740dc2bb-6054-4f0d-88e3-f40bbf8755d3 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:39.318381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f81c5b5f-d262-4127-835b-6234ceba3fbe req-740dc2bb-6054-4f0d-88e3-f40bbf8755d3 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:39.329629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-f81c5b5f-d262-4127-835b-6234ceba3fbe req-740dc2bb-6054-4f0d-88e3-f40bbf8755d3 service nova] Creating event network-vif-deleted:be1a0b48-9f78-477a-a06b-50518f954982 for instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 on hv-cinder-83998 May 18 15:00:39.334481 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-f81c5b5f-d262-4127-835b-6234ceba3fbe req-740dc2bb-6054-4f0d-88e3-f40bbf8755d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028769 May 18 15:00:39.335920 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 312/609] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:39.473404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:39.474103 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:39.481365 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:39.481822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:39.482634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:39.483078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:39.513761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:39.514208 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:39.514654 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lazy-loading 'fault' on Instance uuid 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:00:39.555856 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:39.558132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:39.564798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-75f68625-0e5b-4f1f-b1ed-4df806bcbcef tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 200 len: 1312 microversion: 2.1 time: 0.095276 May 18 15:00:39.565371 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 298/610] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:39 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:40.583680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:40.584306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:40.591054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:40.591506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:40.592277 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:40.592753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:40.596785 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:40.607975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] HTTP exception thrown: Instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 could not be found. May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Request method failure captured: May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 HTTP/1.1 May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjzVOTjOi0UiEostiqI8ORWnqTPMC1uMYluYnsq9j1moIP6jSgbXlZrFRGpt9SM4Md2HF7vcqiZefPkY1vDMbeaAEyZN5aEPjVeRqy6qRee47nQd0LqLnmb0hbFoGvoRer5ZUXDJhPBipl02_RJgfLVdDXmycR5z6fYJ-02NDeJs-A May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 84835592358a4e188df86896d6015647 May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:00:40.609913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/84835592358a4e188df86896d6015647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_84835592358a4e188df86896d6015647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 84835592358a4e188df86896d6015647 May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 2aa34e012c824754833a12ac66413aaf May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 could not be found. May 18 15:00:40.611420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '91f6cf5f-5077-4b01-9a99-ffe0f7a20a17'} May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 could not be found. May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:00:40.613129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 could not be found. May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 could not be found. May 18 15:00:40.614431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:40.615491 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Returning 404 to user: Instance 91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:00:40.615491 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-02079af9-a40a-4e1a-91bf-479a58db6111 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17" status: 404 len: 111 microversion: 2.1 time: 0.032620 May 18 15:00:40.615491 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 313/611] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:40 2022] GET /compute/v2.1/servers/91f6cf5f-5077-4b01-9a99-ffe0f7a20a17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:00:40.620275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:40.620814 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:40.628755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:40.629207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:40.629967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:40.630402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:40.655499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:00:40.730966 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d3035281-6c5d-4366-9152-759d5a1065f4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 204 len: 0 microversion: 2.1 time: 0.114392 May 18 15:00:40.731549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 299/612] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:00:40 2022] DELETE /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:00:40.740243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:40.740906 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:40.748161 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:40.748624 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:40.749393 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:40.749823 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:40.930911 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:40.938292 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3c0cd0f8-73ad-42e5-8a38-08fc97df08d4 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.202537 May 18 15:00:40.938849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 314/613] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:40 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:41.955760 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:41.956450 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:41.963405 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:41.963848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:41.964609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:41.965039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:42.092509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:42.099943 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-eac7d5a2-299d-4727-8727-6932b8944b29 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.148432 May 18 15:00:42.100505 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 300/614] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:41 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:43.118053 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:43.118607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:43.125007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:43.125483 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:43.126250 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:43.126690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:43.257535 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:43.265436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5198c8d4-e852-406d-b837-5c891a684cc6 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.151306 May 18 15:00:43.266006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 315/615] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:43 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:44.282869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:44.283478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:44.289813 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:44.290253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:44.291035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:44.291463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:44.503820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:44.511858 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-233aa2a4-b441-4cf2-a5f9-67bf51da4ba5 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1521 microversion: 2.1 time: 0.232790 May 18 15:00:44.521242 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 301/616] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:44 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:44.828883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-51171dac-ee63-4c08-bd37-23c0a42f7af3 req-5df8642b-377f-443a-bfc9-aaca9620779c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447f7721-8ce1-4cbe-996a-75b2426474bc", "name": "network-vif-deleted", "tag": "57d2f680-f45f-4e76-83e5-1b16aa578a8c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:44.838520 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-51171dac-ee63-4c08-bd37-23c0a42f7af3 req-5df8642b-377f-443a-bfc9-aaca9620779c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:44.838967 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-51171dac-ee63-4c08-bd37-23c0a42f7af3 req-5df8642b-377f-443a-bfc9-aaca9620779c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:44.853285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-51171dac-ee63-4c08-bd37-23c0a42f7af3 req-5df8642b-377f-443a-bfc9-aaca9620779c service nova] Creating event network-vif-deleted:57d2f680-f45f-4e76-83e5-1b16aa578a8c for instance 447f7721-8ce1-4cbe-996a-75b2426474bc on hv-cinder-83998 May 18 15:00:44.858221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-51171dac-ee63-4c08-bd37-23c0a42f7af3 req-5df8642b-377f-443a-bfc9-aaca9620779c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 May 18 15:00:44.858916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 316/617] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:45.529070 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:45.529686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:45.532132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:45.537534 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:45.537981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:45.538742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:45.539175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:45.571179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:45.571621 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:45.572072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lazy-loading 'fault' on Instance uuid 447f7721-8ce1-4cbe-996a-75b2426474bc {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:00:45.617827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa34e012c824754833a12ac66413aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84835592358a4e188df86896d6015647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:45.625387 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2ae3f051-1f01-4071-b33a-876aea9d828b tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 200 len: 1311 microversion: 2.1 time: 0.100215 May 18 15:00:45.626159 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 302/618] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:45 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:46.643902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:46.644510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] [instance: 447f7721-8ce1-4cbe-996a-75b2426474bc] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:46.651160 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:46.651612 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:46.652372 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:46.652845 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:46.666279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] HTTP exception thrown: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc could not be found. May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Request method failure captured: May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc HTTP/1.1 May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjzVOTjOi0UiEostiqI8ORWnqTPMC1uMYluYnsq9j1moIP6jSgbXlZrFRGpt9SM4Md2HF7vcqiZefPkY1vDMbeaAEyZN5aEPjVeRqy6qRee47nQd0LqLnmb0hbFoGvoRer5ZUXDJhPBipl02_RJgfLVdDXmycR5z6fYJ-02NDeJs-A May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 84835592358a4e188df86896d6015647 May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:00:46.667859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/84835592358a4e188df86896d6015647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/84835592358a4e188df86896d6015647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_84835592358a4e188df86896d6015647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 84835592358a4e188df86896d6015647 May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168859250 May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 2aa34e012c824754833a12ac66413aaf May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168859250-project May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc could not be found. May 18 15:00:46.669488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '447f7721-8ce1-4cbe-996a-75b2426474bc'} May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc could not be found. May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:00:46.670417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc could not be found. May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc could not be found. May 18 15:00:46.671959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:46.673334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] Returning 404 to user: Instance 447f7721-8ce1-4cbe-996a-75b2426474bc could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:00:46.673334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b4e99d54-02c0-4d3a-9fd2-f98a9d8f1609 tempest-ServerRescueNegativeTestJSON-168859250 tempest-ServerRescueNegativeTestJSON-168859250-project] 10.222.0.59 "GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc" status: 404 len: 111 microversion: 2.1 time: 0.030185 May 18 15:00:46.673334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 317/619] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:46 2022] GET /compute/v2.1/servers/447f7721-8ce1-4cbe-996a-75b2426474bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:00:50.985228 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:00:50.985821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Wed May 18 15:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:00:51.572945 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:51.573914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:51.580896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:51.581369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:51.582135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:51.582554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:51.611999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-eb1cf8df-4841-4afc-bf54-360260fb431d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043476 May 18 15:00:51.612695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 303/620] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:00:51 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:00:51.670521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:51.671034 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:51.678229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:51.678938 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:51.680222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:51.680685 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:51.705208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:00:51.789797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-cc4df9ee-a157-4a7e-b588-64c58c4da503 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 204 len: 0 microversion: 2.1 time: 0.122664 May 18 15:00:51.793924 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 318/621] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:00:51 2022] DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:00:51.800016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:51.800988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:51.809918 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:51.810453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:51.811392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:51.812119 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:52.105674 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:52.113660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3d4bafba-1203-45ae-9522-b158aa345239 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1673 microversion: 2.1 time: 0.318429 May 18 15:00:52.114236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 304/622] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:51 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1673 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:52.913463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:52.914688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:52.921582 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:52.922282 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:52.923235 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:52.923678 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:52.951806 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8c5c4f53-d261-4bfd-8c9f-28bfa789699d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.237075 May 18 15:00:52.953013 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 319/623] 10.222.0.59 () {60 vars in 1288 bytes} [Wed May 18 15:00:52 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/ips => generated 151 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 15:00:53.131596 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:53.132384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:53.147617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:53.149183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:53.150701 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:53.153213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:53.420978 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:53.430350 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9ac70ef9-f5f1-4d2b-9654-00d340bb8427 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1673 microversion: 2.1 time: 0.302694 May 18 15:00:53.431123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 305/624] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:53 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1673 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:53.639724 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:53.640174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:53.646454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:53.647060 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:53.647839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:53.648274 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:53.672771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lazy-loading 'flavor' on Instance uuid 2c69b24f-4d86-449b-897d-ebf6e2ac43fb {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:00:53.776711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8ab0fad7-c522-4635-886c-1cca8154a330 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "POST /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb/action" status: 202 len: 0 microversion: 2.1 time: 0.141001 May 18 15:00:53.780361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 320/625] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 15:00:53 2022] POST /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:00:53.786115 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:53.788951 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:53.795639 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:53.796316 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:53.797425 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:53.798023 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:54.070989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:54.080179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-24fc62ca-eb54-45dc-8c75-7f32100ab483 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.297947 May 18 15:00:54.088610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 306/626] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:53 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:54.448621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:54.449607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:54.457029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:54.457562 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:54.458601 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:54.459041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:54.826155 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:54.834595 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a01a03fb-05df-4a3a-a247-3c1d9c61180c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1673 microversion: 2.1 time: 0.390962 May 18 15:00:54.839516 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 321/627] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:54 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1673 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:54.868742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:54.869275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:54.882651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:54.883100 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:54.883874 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:54.884475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:54.920075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lazy-loading 'flavor' on Instance uuid b9394fe1-b670-4e51-b247-71558d6f56ca {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:00:55.098174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:55.098880 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:55.106013 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:55.106524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:55.107535 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:55.108179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:55.306624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-197b32de-2f8c-49d7-9816-7db389b69b0d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/action" status: 202 len: 0 microversion: 2.20 time: 0.441629 May 18 15:00:55.310279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 307/628] 10.222.0.59 () {62 vars in 1318 bytes} [Wed May 18 15:00:54 2022] POST /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 15:00:55.316972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:55.317860 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:55.325565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:55.326004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:55.327131 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:55.328614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:55.385844 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:55.400672 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f1e6b35d-bfb9-4fdd-936b-5d2800daa743 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.306778 May 18 15:00:55.401261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 322/629] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:55 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:55.727084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:55.741400 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:55.746060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:55.750301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7dfdaef8-ed66-4287-a280-5595d4c71425 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.438363 May 18 15:00:55.751114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 308/630] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:55 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:00:55.857197 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:55.859484 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:55.868003 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:55.868762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:55.869864 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:55.870420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:55.981765 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:56.001555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c7382b08-7f30-4fb9-8e2e-aec452fbcfda tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 200 len: 1606 microversion: 2.1 time: 0.138747 May 18 15:00:56.002174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 323/631] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:55 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 1606 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:56.090033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-0ef177ca-8fd6-47bf-a402-5d3db00bca66 req-bc6e37e7-2ef9-4b36-aa3e-358081b2d95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7efce9-bda4-4d05-a813-164f962babab", "name": "network-vif-deleted", "tag": "8c977413-3f2a-4a40-84bc-101572b4ab37"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:56.099836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-0ef177ca-8fd6-47bf-a402-5d3db00bca66 req-bc6e37e7-2ef9-4b36-aa3e-358081b2d95c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:56.100548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-0ef177ca-8fd6-47bf-a402-5d3db00bca66 req-bc6e37e7-2ef9-4b36-aa3e-358081b2d95c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:56.113050 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-0ef177ca-8fd6-47bf-a402-5d3db00bca66 req-bc6e37e7-2ef9-4b36-aa3e-358081b2d95c service nova] Creating event network-vif-deleted:8c977413-3f2a-4a40-84bc-101572b4ab37 for instance ee7efce9-bda4-4d05-a813-164f962babab on hv-cinder-83998 May 18 15:00:56.122060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-0ef177ca-8fd6-47bf-a402-5d3db00bca66 req-bc6e37e7-2ef9-4b36-aa3e-358081b2d95c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 May 18 15:00:56.123018 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 309/632] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:56.422828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:56.425101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:56.437459 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:56.438248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:56.439407 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:56.440044 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:56.771151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:56.771778 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:56.781119 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:56.782421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:56.783216 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:56.783968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:56.950512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:56.959789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-709768e4-7418-47b9-bade-1b0a6c7976e7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.543709 May 18 15:00:56.960027 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 324/633] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:56 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:57.019813 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:57.020948 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:57.027395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:57.027811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:57.028910 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:57.029347 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:57.044237 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] HTTP exception thrown: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:00:57.045456 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Request method failure captured: May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab HTTP/1.1 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlI4lsSYyCxifEimwgRH-6frduWxVqxyw2KKX68W_RJ1jYvXuSJtQdU2jeB5J7TNUamgpuKtW4gVKCflWNFpjSUTTxxCqz469Pu_fQuAgQTWLXrGUW-Ddr5dGlb9aD5DYm0AV3ir0b46CYxtMTNvHViH0Pp5kzulZqqoOPkeZmUe_8 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:00:57.046376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeTestJSON-1717291894 May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 88c71f6ddf364c9baca69e459547ab02 May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:00:57.047812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'ee7efce9-bda4-4d05-a813-164f962babab'} May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:00:57.048616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:00:57.049783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:00:57.052318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Returning 404 to user: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:00:57.053429 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-71015fc5-29f0-4bd5-941c-5e29978e52bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 404 len: 111 microversion: 2.1 time: 0.038640 May 18 15:00:57.058692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 325/634] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:57 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:00:57.061425 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:57.063181 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:57.063444 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c12d1c10-6f9f-4661-aba6-12067327d04a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '.version_select at 0x7fa8a085f700>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:57.064518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f0248ac8-e228-4441-86be-6686426b20e1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.298884 May 18 15:00:57.065175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 310/635] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:56 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:00:57.083944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c12d1c10-6f9f-4661-aba6-12067327d04a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203252478" status: 202 len: 0 microversion: 2.1 time: 0.024071 May 18 15:00:57.084512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 326/636] 10.222.0.59 () {58 vars in 1220 bytes} [Wed May 18 15:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203252478 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:00:57.407861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-00f13a36-6f49-41f5-bb54-f5a8c915e396 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: .version_select at 0x7fa8a08f5280>, body: {"keypair": {"name": "tempest-keypair-579381023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0W0TcHNI3YX884EMDUHuIKJhgw/Tr8y4wo2PY5E7h8yN0m3vRY4RYIDnfE7F6IaHAyrTZVbqWYbV0qeobQ4lCCn6XCuZlKnvbop5AmT33WXXV9OxIUYzlM5Ei0YY5C6g=="}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:57.438929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-00f13a36-6f49-41f5-bb54-f5a8c915e396 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:00:57.443409 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-00f13a36-6f49-41f5-bb54-f5a8c915e396 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:00:57.471153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-00f13a36-6f49-41f5-bb54-f5a8c915e396 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137064 May 18 15:00:57.471796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 311/637] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 15:00:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:57.899500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-103132d8-9e67-4596-ab90-de2b243e6712 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: .version_select at 0x7fa8a080dd30>, body: {"keypair": {"name": "tempest-keypair-2043148498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBkThW6kX794WYY20fJp7HtPVfTeSQk9Le5Iz10GdjWf29BqZo5qRZE+4kBRsrXgRU0pbnY6yrvEOGLG3C60XBObdXR1yRfymbWWhUbfidbwlgwxmduOMsdfEzbyETl0Q=="}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:57.918013 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-103132d8-9e67-4596-ab90-de2b243e6712 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:00:57.922423 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-103132d8-9e67-4596-ab90-de2b243e6712 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for user 88c71f6ddf364c9baca69e459547ab02 and project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:00:57.951650 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-103132d8-9e67-4596-ab90-de2b243e6712 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056544 May 18 15:00:57.953299 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 327/638] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 15:00:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:00:57.977471 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:57.978302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:57.991261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:57.991991 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:57.993658 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:57.994455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:58.085577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:58.086738 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:58.096867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:58.097320 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:58.098111 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:58.098550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:58.364112 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:58.375055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8bd9975f-c8f7-44f0-84a3-f46f3dbf3615 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.402054 May 18 15:00:58.381176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 312/639] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:57 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:58.428210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:58.442206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:58.451375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:58.452519 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1e66acb9-83be-4350-b397-f5f1b47ac9c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.372329 May 18 15:00:58.453206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 328/640] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:58 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:00:59.395215 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:59.395789 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:59.403365 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:59.404125 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:59.405207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:59.405680 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:59.427081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:59.443089 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-35257394", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9022122f-bfa2-48d6-ae5d-8c609a059727"}], "security_groups": [{"name": "tempest-securitygroup--40508810"}], "key_name": "tempest-keypair-579381023", "user_data": "}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:00:59.647630 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] validate_networks() for [('9022122f-bfa2-48d6-ae5d-8c609a059727', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:00:59.665133 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:00:59.674159 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f54fbb49-0429-4587-8463-b743a7da77bf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.282777 May 18 15:00:59.675269 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 313/641] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:00:59 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:00:59.680384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:00:59.681098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:00:59.687342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:59.687879 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:00:59.688755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:00:59.689264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:00.015740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:00.023684 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:00.025255 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:00.026455 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d3664da5-ee61-4788-87b0-100bbb01067d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.350028 May 18 15:01:00.027015 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 314/642] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:00:59 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:00.346289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-986237267", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6d46917-2e57-430f-9dbe-54ed4755b607"}], "security_groups": [{"name": "tempest-securitygroup--379719865"}], "key_name": "tempest-keypair-2043148498", "user_data": "}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:00.350911 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:01:00.351854 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:01:00.352327 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:01:00.352777 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:01:00.353194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:01:00.362152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:00.362598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:00.363493 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:00.364030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:00.381149 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:01:00.385370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:01:00.397112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:01:00.399420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:01:00.446607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3c1c1bbe-bf9e-40a0-b588-637b039f7d8d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.008062 May 18 15:01:00.447629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 329/643] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:00:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 15:01:00.447847 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] validate_networks() for [('f6d46917-2e57-430f-9dbe-54ed4755b607', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:01:00.458680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-755978ac-e735-4031-85f1-3ddeb7abca37 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:00.459361 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-755978ac-e735-4031-85f1-3ddeb7abca37 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:00.546619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-755978ac-e735-4031-85f1-3ddeb7abca37 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:00.554447 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-755978ac-e735-4031-85f1-3ddeb7abca37 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1239 microversion: 2.1 time: 0.100894 May 18 15:01:00.555523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 330/644] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:00 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:00.691009 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:00.691628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:00.698859 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:00.699316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:00.700084 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:00.700761 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:00.964622 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:00.972062 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c0573aea-154b-4c6d-832b-ff02dd39fa37 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.284910 May 18 15:01:00.972659 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 331/645] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:00 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:01.009307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:01:01.009771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:01:01.010268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:01:01.010688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:01:01.011107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:01:01.020450 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.020948 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:01.021750 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.022196 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:01.039359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:01:01.043553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Getting quotas for user 88c71f6ddf364c9baca69e459547ab02 and project c9a08f2c9b8b49f6a5de343bf8826601. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:01:01.044954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:01.047098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:01.053957 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.055454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:01.057127 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.057735 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:01.059066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:01:01.061636 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:01:01.112564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9d2af13e-2f66-4bec-ac6c-fa73039eae41 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.770491 May 18 15:01:01.119203 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 315/646] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:01:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 15:01:01.124983 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0629ccfa-76de-4c60-95d5-044b3be0cb84 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:01.126290 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0629ccfa-76de-4c60-95d5-044b3be0cb84 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:01.197197 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0629ccfa-76de-4c60-95d5-044b3be0cb84 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:01.205852 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0629ccfa-76de-4c60-95d5-044b3be0cb84 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1237 microversion: 2.1 time: 0.084511 May 18 15:01:01.216014 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 316/647] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:01 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:01.251912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:01.259054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:01.269230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:01.270949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:01.273288 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-13b63b02-7ed1-4165-b6ce-e684770e6493 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.231595 May 18 15:01:01.274253 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 332/648] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:01 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:01.572361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:01.573033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:01.580417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.582258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:01.583077 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.583524 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:01.655637 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:01.663391 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-42387250-d71a-4f54-a068-8e797460d487 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1291 microversion: 2.1 time: 0.095874 May 18 15:01:01.664835 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 317/649] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:01 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:01.989831 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:01.990441 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:01.993193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:01.999305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:01.999746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.000515 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.000958 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.133457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:02.140921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-54ac23d3-07ad-4b05-bdf9-dceffdc9e395 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.154912 May 18 15:01:02.141489 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 333/650] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:01 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:02.222502 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:02.223754 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:02.230492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.231241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.233172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.233172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.293350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:02.294028 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:02.299943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.300642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.301685 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.302214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.312261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:02.321332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-99d1c4f5-9814-45a6-b44c-0fa8de77ee0a tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1289 microversion: 2.1 time: 0.102361 May 18 15:01:02.326006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 318/651] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:02 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:02.518416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:02.527544 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:02.529351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:02.530771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-582651c9-7a0f-42f2-84f4-223cc56d5015 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.241886 May 18 15:01:02.531524 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 334/652] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:02 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:02.682213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:02.682836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:02.689736 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.690521 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.691320 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:02.691753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:02.764423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:02.772548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4a66d55e-0c00-4138-b354-24810ba76361 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1297 microversion: 2.1 time: 0.094835 May 18 15:01:02.774030 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 319/653] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:02 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:03.158912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:03.159910 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:03.168625 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.169411 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.171213 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.171866 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.339548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:03.340156 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:03.347145 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.347998 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.353092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.353951 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.782613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:03.791092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:03.807273 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fe996d0a-4ad6-4170-ada9-d2cefc319bf7 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.472009 May 18 15:01:03.810903 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 320/654] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:03 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:03.812307 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b42c7a23-1121-4f5e-a7e5-66ff5f6e0570 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.657778 May 18 15:01:03.814330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 335/655] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:03 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:03.820601 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:03.821565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:03.828169 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:03.829117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:03.836511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.840649 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.841647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.842037 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.842668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.843281 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:03.847051 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:03.847697 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:04.234918 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:04.249333 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a5772c3a-4afa-4d1d-ab4a-6e7cfd343b5e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.433259 May 18 15:01:04.249935 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 336/656] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:03 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:04.278525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:04.294935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:04.296819 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:04.298590 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-421f99c3-9746-45ae-937e-7b81cd991487 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.485217 May 18 15:01:04.299482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 321/657] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:03 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:04.328146 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1525091347"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:04.328861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:04.338477 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-373ff2d4-535d-4ce0-bd43-8993dc15d8e3 req-e731b6a4-e30b-4c2e-8614-a16d0d847a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f721eb0d-b804-41bd-ade4-95019478aef5", "tag": "768c0e8a-8f7d-4532-b2e5-1defde7dd51c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:04.348523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-373ff2d4-535d-4ce0-bd43-8993dc15d8e3 req-e731b6a4-e30b-4c2e-8614-a16d0d847a91 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:04.349206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-373ff2d4-535d-4ce0-bd43-8993dc15d8e3 req-e731b6a4-e30b-4c2e-8614-a16d0d847a91 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:04.357862 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:04.358367 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:04.359183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:04.359889 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:04.366072 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-373ff2d4-535d-4ce0-bd43-8993dc15d8e3 req-e731b6a4-e30b-4c2e-8614-a16d0d847a91 service nova] Creating event network-changed:768c0e8a-8f7d-4532-b2e5-1defde7dd51c for instance f721eb0d-b804-41bd-ade4-95019478aef5 on hv-cinder-83998 May 18 15:01:04.371902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-373ff2d4-535d-4ce0-bd43-8993dc15d8e3 req-e731b6a4-e30b-4c2e-8614-a16d0d847a91 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120767 May 18 15:01:04.372695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 337/658] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:04.655334 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.network.security_group_api [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Removing security group 87209f13-ae86-4e34-8404-fc5ce5ccdd43 from port 13109190-8799-4d42-a04f-c61a209975be May 18 15:01:04.760956 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-5e9ea2c3-3424-47f7-b6fc-4288e7b14d17 req-06350c05-21ed-4f45-a9b1-fdf8cb164666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56dffbf3-4309-4b9f-992f-118a9d2b3563", "tag": "0ed1e1a7-57d4-4ca3-9a56-96e3e696207c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:04.769916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-5e9ea2c3-3424-47f7-b6fc-4288e7b14d17 req-06350c05-21ed-4f45-a9b1-fdf8cb164666 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:04.770382 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-5e9ea2c3-3424-47f7-b6fc-4288e7b14d17 req-06350c05-21ed-4f45-a9b1-fdf8cb164666 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:04.782544 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-5e9ea2c3-3424-47f7-b6fc-4288e7b14d17 req-06350c05-21ed-4f45-a9b1-fdf8cb164666 service nova] Creating event network-changed:0ed1e1a7-57d4-4ca3-9a56-96e3e696207c for instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 on hv-cinder-83998 May 18 15:01:04.787280 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-5e9ea2c3-3424-47f7-b6fc-4288e7b14d17 req-06350c05-21ed-4f45-a9b1-fdf8cb164666 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032443 May 18 15:01:04.788036 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 338/659] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:01:04.828123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:04.828883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:04.836417 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:04.836901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:04.838015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:04.838392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.060789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:05.068187 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3fbe8367-d0b9-485a-ac79-4aeb394186aa tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.244756 May 18 15:01:05.068807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 339/660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:04 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:05.073490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:05.074112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:05.082182 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:05.082182 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.082895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:05.083332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.261656 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:05.269248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d2035615-6db2-4227-9094-da8ef8d9b397 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.199300 May 18 15:01:05.269832 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 340/661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:05 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:05.274349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:05.274949 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:05.281258 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:05.281738 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.282547 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:05.282998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.348951 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5368c79f-6b6f-4f73-b7dd-6d6468353250 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/action" status: 202 len: 0 microversion: 2.1 time: 1.047974 May 18 15:01:05.349957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 322/662] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 15:01:04 2022] POST /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/action => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:01:05.357244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:05.358117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:05.369324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:05.370216 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.371210 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:05.371885 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:05.548266 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:05.561676 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-43110fc9-ccc0-4ead-8f00-6fa074406eb1 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.290220 May 18 15:01:05.566310 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 341/663] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:05 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:05.656784 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:05.666962 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:05.670151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:05.671625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4e78eb31-9522-4250-a016-d0e0ca2ca5bb tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.320446 May 18 15:01:05.672395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 323/664] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:05 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:06.085467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:06.086410 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:06.093107 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.094129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.094350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.094792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.286504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:06.287671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:06.294775 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.295228 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.295999 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.296431 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.794511 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:06.802254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6ab6183e-1386-4570-a982-34ec03e2c60f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.721021 May 18 15:01:06.803112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 342/665] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:06 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:06.808312 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:06.808975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:06.815168 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.815918 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.816855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.817296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.855157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:06.862691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-dc967a73-39a9-4f6c-ab4e-5933c89da2f3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.580118 May 18 15:01:06.863306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 324/666] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:06 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:06.868124 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:06.869006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:06.874948 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.875388 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:06.876145 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:06.876574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.077043 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:07.084534 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a4fa5716-1197-4da4-b4d4-5684f8af3570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.279797 May 18 15:01:07.085218 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 343/667] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:06 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:07.147674 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-f9481be4-c143-4c31-8e61-9816f9ce93c9 req-7a5d28c0-80a4-4329-a54b-d06cdaa98f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:07.156285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f9481be4-c143-4c31-8e61-9816f9ce93c9 req-7a5d28c0-80a4-4329-a54b-d06cdaa98f72 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.156908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f9481be4-c143-4c31-8e61-9816f9ce93c9 req-7a5d28c0-80a4-4329-a54b-d06cdaa98f72 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.163831 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:07.170135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-f9481be4-c143-4c31-8e61-9816f9ce93c9 req-7a5d28c0-80a4-4329-a54b-d06cdaa98f72 service nova] Creating event network-changed:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 15:01:07.172195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:07.173822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:07.175070 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-17dc3e5d-627e-446c-a23c-9fed4696bd7b tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.310528 May 18 15:01:07.175192 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-f9481be4-c143-4c31-8e61-9816f9ce93c9 req-7a5d28c0-80a4-4329-a54b-d06cdaa98f72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088231 May 18 15:01:07.176159 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 325/669] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:06 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:07.176286 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 344/669] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:07.475828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:07.476403 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:07.482628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.483072 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.483833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.484303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.569751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lazy-loading 'services' on Instance uuid 1d158898-fe22-450d-8a03-33f781b6fa1f {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:01:07.641580 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-91f6a058-6fe5-4339-af12-e79e3dc89bb6 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments/1a93b982-ae17-40be-a594-41bee6abe7a8" status: 202 len: 0 microversion: 2.1 time: 0.169881 May 18 15:01:07.642273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 345/670] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:01:07 2022] DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments/1a93b982-ae17-40be-a594-41bee6abe7a8 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:01:07.650750 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:07.651774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:07.657952 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.658400 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.659158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.659592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.689010 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-68958e26-7dfb-4054-8a77-6a70f0456ec0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 May 18 15:01:07.689573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 326/671] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:01:07 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:07.819971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:07.820700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:07.827055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.827506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.828377 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.828870 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.879117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:07.879818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:07.886001 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.886728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.887573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:07.888086 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:07.996036 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:08.007176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9712281a-ccf9-4afc-a908-9b70bbc81546 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.191199 May 18 15:01:08.017737 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 346/672] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:07 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:08.107826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:08.109731 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:08.121892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:08.123381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:08.124568 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:08.126768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:08.145894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:08.155254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f96021c6-5be4-497d-9042-4ab2c6ab51cf tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.279857 May 18 15:01:08.175528 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 327/673] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:07 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:08.193436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:08.194843 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:08.202469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:08.203294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:08.204661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:08.205338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:08.360139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:08.368363 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e72ea680-a97d-4412-844f-ec9e77e45e91 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.268041 May 18 15:01:08.369200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 347/674] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:08 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:08.391680 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:08.400422 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:08.401965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:08.403130 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-374541af-61b5-4847-afaf-0f7f39775ca9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.214075 May 18 15:01:08.406334 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 328/675] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:08 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:08.702093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:08.703110 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:08.708977 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:08.709432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:08.710195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:08.711334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:08.738970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a14e62f6-fb93-441b-8896-e5d682b1bac5 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040895 May 18 15:01:08.739547 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 348/676] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:01:08 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:09.026786 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:09.028200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:09.035431 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.035965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.036961 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.037470 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.183539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:09.184237 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:09.195766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.196306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.197201 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.197712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.207869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:09.217811 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-15a0f551-4ebb-4800-b2d9-3a65628db4e5 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.196843 May 18 15:01:09.218415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 329/677] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:09 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:09.223107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-186715c8-64cd-4178-9261-619b22cfb90b req-5a058e7e-6e01-4e50-9c00-5fae8303ea0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:09.231206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-186715c8-64cd-4178-9261-619b22cfb90b req-5a058e7e-6e01-4e50-9c00-5fae8303ea0a service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.231648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-186715c8-64cd-4178-9261-619b22cfb90b req-5a058e7e-6e01-4e50-9c00-5fae8303ea0a service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.244033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-186715c8-64cd-4178-9261-619b22cfb90b req-5a058e7e-6e01-4e50-9c00-5fae8303ea0a service nova] Creating event network-changed:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 15:01:09.249175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-186715c8-64cd-4178-9261-619b22cfb90b req-5a058e7e-6e01-4e50-9c00-5fae8303ea0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029423 May 18 15:01:09.249785 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 330/678] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:09.335206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:09.343346 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c74ca7aa-6088-4c44-8161-0e0f8ea03f35 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.164116 May 18 15:01:09.343916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 349/679] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:09 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:09.386072 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:09.386776 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:09.392981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.393429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.394186 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.394624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.420323 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:09.420968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:09.426903 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.427350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.428119 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.428556 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.596325 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:09.604906 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e3bf6502-a43b-40d3-9636-59c873f74d76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.223407 May 18 15:01:09.605470 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 331/680] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:09 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:09.624675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:09.629390 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:09.636251 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:09.637852 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:09.639042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e087ca61-132a-4043-9850-1f91905d78e2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.222489 May 18 15:01:09.650187 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 350/681] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:09 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:09.751051 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:09.752012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:09.757991 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.758438 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.759229 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:09.759664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:09.774214 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=100 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:09.791695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5c40a1b6-1e15-4457-af81-ff7d8aea527e tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 May 18 15:01:09.792260 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 332/682] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:01:09 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:10.103699 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-cf61ad97-1bf2-4579-90ca-787c6cf9c486 req-3006f7ef-1918-4d3b-bb03-1153db1631d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f721eb0d-b804-41bd-ade4-95019478aef5", "name": "network-vif-plugged", "status": "completed", "tag": "768c0e8a-8f7d-4532-b2e5-1defde7dd51c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:10.114379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-cf61ad97-1bf2-4579-90ca-787c6cf9c486 req-3006f7ef-1918-4d3b-bb03-1153db1631d0 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.114907 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-cf61ad97-1bf2-4579-90ca-787c6cf9c486 req-3006f7ef-1918-4d3b-bb03-1153db1631d0 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.128173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-cf61ad97-1bf2-4579-90ca-787c6cf9c486 req-3006f7ef-1918-4d3b-bb03-1153db1631d0 service nova] Creating event network-vif-plugged:768c0e8a-8f7d-4532-b2e5-1defde7dd51c for instance f721eb0d-b804-41bd-ade4-95019478aef5 on hv-cinder-83998 May 18 15:01:10.134504 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-cf61ad97-1bf2-4579-90ca-787c6cf9c486 req-3006f7ef-1918-4d3b-bb03-1153db1631d0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 May 18 15:01:10.136042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 351/683] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:10.234353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.235029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.242337 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.243007 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.243804 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.244404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.361358 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.362068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.368377 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.368896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.369694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.370135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.374669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:10.375287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:10.382823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-64c12604-7458-4306-8894-18bdf325c988 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.152230 May 18 15:01:10.383485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 333/684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:10 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:10.519902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:10.529982 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2b75023f-9f3c-4dc6-9ad5-80ddb825bbee tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1568 microversion: 2.1 time: 0.173345 May 18 15:01:10.531373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 352/685] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:10 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:10.548257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:10.548840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.555787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.556239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.557181 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.558435 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.623691 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.624511 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.626581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=12 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:10.632839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.633466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.634435 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.634933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.645723 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-373f9631-2eda-45e0-8437-0b181d8bcd92 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "POST /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb/action" status: 202 len: 0 microversion: 2.1 time: 0.101700 May 18 15:01:10.646814 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 334/686] 10.222.0.59 () {60 vars in 1277 bytes} [Wed May 18 15:01:10 2022] POST /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:01:10.657516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.658201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.666206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.666943 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.668280 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.669090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.850368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:10.858317 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-fae35615-dfd8-4ebe-9ac2-bdc439e65838 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.240285 May 18 15:01:10.858896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 353/687] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:10 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:10.864757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.865371 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.871313 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.871765 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.872879 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.873647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.889624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:10.897230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2cd93a7b-c170-46ab-9725-b5931cb5e41a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1516 microversion: 2.1 time: 0.244661 May 18 15:01:10.898547 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 335/688] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:10 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:10.904286 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.905306 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.907672 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:10.913261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.913743 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.914515 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.914950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.950505 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-667cdf5e-ff7e-4190-b1c3-54cd39cd3ce1 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050700 May 18 15:01:10.951745 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 336/689] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:01:10 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:01:10.961963 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:10.962458 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:10.968357 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.968965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:10.969755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:10.970195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:11.024968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:11.029641 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:11.033548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:11.034999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:11.036189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5dd5c883-94e6-45ea-aee2-7d5491dde74f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.176374 May 18 15:01:11.036783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 354/690] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:10 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:11.058332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] HTTP exception thrown: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f is not attached to volume 1a93b982-ae17-40be-a594-41bee6abe7a8 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Request method failure captured: May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments/1a93b982-ae17-40be-a594-41bee6abe7a8 HTTP/1.1 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQmToqxVJ0qAcDu_IqrtjzJF-z4Lk4eJLv5vG3gWxqX8Sn7j4NW19yJD643JMggOMX0JqpL0UO-gJ_cPc-TUZShqDvlRSPpx0JP-mF05p_6nIpapb6yYgeyOPWSwqlDsVQVqxHqxboEbaQnCR7uj5_f3OuHJU40Y1L_5aw7oPnHrzkk May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 51aa9f371a9c4b20bd52f8e251c80711 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-TestMinimumBasicScenario-595701846 May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:01:11.068082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-TestMinimumBasicScenario-595701846 May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 51aa9f371a9c4b20bd52f8e251c80711 May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-TestMinimumBasicScenario-595701846 May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-TestMinimumBasicScenario-595701846-project May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 0eed26f817524cc292be459f2aaa6f6e May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-TestMinimumBasicScenario-595701846-project May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:01:11.069565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f is not attached to volume 1a93b982-ae17-40be-a594-41bee6abe7a8 May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'server_id': '1d158898-fe22-450d-8a03-33f781b6fa1f', 'id': '1a93b982-ae17-40be-a594-41bee6abe7a8'} May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1a93b982-ae17-40be-a594-41bee6abe7a8. May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:01:11.070798 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f is not attached to volume 1a93b982-ae17-40be-a594-41bee6abe7a8 May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f is not attached to volume 1a93b982-ae17-40be-a594-41bee6abe7a8 May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:11.072012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Returning 404 to user: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f is not attached to volume 1a93b982-ae17-40be-a594-41bee6abe7a8 {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:01:11.072929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1c1620bb-ac7e-495a-9913-3a891d642dfc tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments/1a93b982-ae17-40be-a594-41bee6abe7a8" status: 404 len: 154 microversion: 2.1 time: 0.112660 May 18 15:01:11.072929 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 337/691] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:01:10 2022] DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f/os-volume_attachments/1a93b982-ae17-40be-a594-41bee6abe7a8 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:01:11.399778 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:11.400292 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:11.406658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:11.407100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:11.407887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:11.408334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:11.549466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:11.557863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-02a0bfc4-e62c-48fd-82ec-954fd589d6a9 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1362 microversion: 2.1 time: 0.161978 May 18 15:01:11.558498 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 355/692] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:11 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:11.874982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:11.875628 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:11.877476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=12 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:11.883611 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:11.884065 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:11.884873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:11.885313 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:11.915683 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:11.916309 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:11.922344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:11.922797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:11.923575 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:11.924017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.066656 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.074060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-02f26333-1972-417e-b5be-79e14f73d29d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.202948 May 18 15:01:12.082496 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 338/693] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:11 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:12.082496 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:12.082496 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:12.087506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.088398 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.089288 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.089826 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.096194 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.104977 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c9ea1055-f811-42a1-9376-de54120abc0c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1518 microversion: 2.1 time: 0.193504 May 18 15:01:12.105814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 356/694] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:11 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:12.174846 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-aa3518a5-9b9c-4ce3-8828-32e880141199 req-0f1d8d72-881e-4073-b4a1-ecc244f290c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "name": "network-vif-unplugged", "status": "completed", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:12.185525 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-aa3518a5-9b9c-4ce3-8828-32e880141199 req-0f1d8d72-881e-4073-b4a1-ecc244f290c8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.186209 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-aa3518a5-9b9c-4ce3-8828-32e880141199 req-0f1d8d72-881e-4073-b4a1-ecc244f290c8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.206953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.compute.server_external_events [req-aa3518a5-9b9c-4ce3-8828-32e880141199 req-0f1d8d72-881e-4073-b4a1-ecc244f290c8 service nova] Unable to find a host for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb. Dropping event network-vif-unplugged {{(pid=123864) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 18 15:01:12.212341 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-aa3518a5-9b9c-4ce3-8828-32e880141199 req-0f1d8d72-881e-4073-b4a1-ecc244f290c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037392 May 18 15:01:12.213348 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 357/695] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 15:01:12.223097 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:12.223620 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:12.230153 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.230603 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.231385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.231828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.258279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:01:12.340840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ee0a9f29-7b14-40aa-8ca4-601ef495b8c0 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 204 len: 0 microversion: 2.1 time: 0.126167 May 18 15:01:12.345123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 358/696] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:01:12 2022] DELETE /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:01:12.350489 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:12.351409 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:12.358814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.359016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.359871 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.360231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.419598 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.427892 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.429748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.430908 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-db659672-2791-45ec-8837-54eb9bf3ba4a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1743 microversion: 2.20 time: 0.355279 May 18 15:01:12.431457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 339/697] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:12 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1743 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:12.501095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.509140 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d582fba0-9290-4087-9cf6-6d39ccb02578 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1555 microversion: 2.1 time: 0.162851 May 18 15:01:12.509711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 359/698] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:12 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:12.576184 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:12.576826 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:12.582817 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.583266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.584058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.584494 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.716238 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:12.723556 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c4f3fdb6-62a7-48ce-9d2b-43d04bd7f1db tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1547 microversion: 2.1 time: 0.151701 May 18 15:01:12.724107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 340/699] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:12 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:12.739554 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:12.740053 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:12.746439 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.746887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.747645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:12.748081 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:12.988829 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-663ee850-2324-4369-aca2-a601370f9fac tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253000 May 18 15:01:12.989426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 360/700] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 15:01:12 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:13.091035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:13.091745 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:13.098610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.099107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.099993 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.100427 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.123120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:13.124042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:13.130229 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.130795 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.131581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.132022 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.439125 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:13.446742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-aae16c12-cf0e-41b4-9493-64bbbe9a0612 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.359520 May 18 15:01:13.447301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 341/701] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:13 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:13.451689 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:13.452285 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:13.458012 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.458452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.459203 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.459635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.479433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:13.487536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d9e7973f-7bea-4415-ab8c-58281075e02c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1518 microversion: 2.1 time: 0.368208 May 18 15:01:13.488237 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 361/702] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:13 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1518 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:13.526819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:13.527587 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:13.533661 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.534118 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.534891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:13.535332 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:13.754388 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:13.762912 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:13.764660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:13.765867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f8c689c6-d770-4050-ab78-2d7cb08a20a3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1743 microversion: 2.20 time: 0.317665 May 18 15:01:13.766415 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 342/703] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:13 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:13.784838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:13.792301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6fa061b0-3822-45a7-838a-dc5453edec4b tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1555 microversion: 2.1 time: 0.269871 May 18 15:01:13.793001 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 362/704] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:13 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:14.330189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-e7f3c31c-53ca-45d3-9832-8c7bb2ca3ad5 req-c274cf06-d354-432c-a800-23d9487d42eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dffbf3-4309-4b9f-992f-118a9d2b3563", "name": "network-vif-plugged", "status": "completed", "tag": "0ed1e1a7-57d4-4ca3-9a56-96e3e696207c"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:14.339452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e7f3c31c-53ca-45d3-9832-8c7bb2ca3ad5 req-c274cf06-d354-432c-a800-23d9487d42eb service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.339901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e7f3c31c-53ca-45d3-9832-8c7bb2ca3ad5 req-c274cf06-d354-432c-a800-23d9487d42eb service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.357571 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-e7f3c31c-53ca-45d3-9832-8c7bb2ca3ad5 req-c274cf06-d354-432c-a800-23d9487d42eb service nova] Creating event network-vif-plugged:0ed1e1a7-57d4-4ca3-9a56-96e3e696207c for instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 on hv-cinder-83998 May 18 15:01:14.363027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-e7f3c31c-53ca-45d3-9832-8c7bb2ca3ad5 req-c274cf06-d354-432c-a800-23d9487d42eb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103865 May 18 15:01:14.363789 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 343/705] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:14.463442 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:14.469713 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:14.477279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.477812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.478742 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.479257 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.497190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-d0029536-b829-4c1a-af73-2feb08e3e4fb req-783e4620-a5e7-480a-bff9-fb8c384d4ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f721eb0d-b804-41bd-ade4-95019478aef5", "tag": "768c0e8a-8f7d-4532-b2e5-1defde7dd51c"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:14.510851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-d0029536-b829-4c1a-af73-2feb08e3e4fb req-783e4620-a5e7-480a-bff9-fb8c384d4ec8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.511401 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-d0029536-b829-4c1a-af73-2feb08e3e4fb req-783e4620-a5e7-480a-bff9-fb8c384d4ec8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.524854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-d0029536-b829-4c1a-af73-2feb08e3e4fb req-783e4620-a5e7-480a-bff9-fb8c384d4ec8 service nova] Creating event network-changed:768c0e8a-8f7d-4532-b2e5-1defde7dd51c for instance f721eb0d-b804-41bd-ade4-95019478aef5 on hv-cinder-83998 May 18 15:01:14.530793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-d0029536-b829-4c1a-af73-2feb08e3e4fb req-783e4620-a5e7-480a-bff9-fb8c384d4ec8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039526 May 18 15:01:14.531916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 344/706] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:01:14.537783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:14.539241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:14.546728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.547544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.548604 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.549267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.749000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:14.759873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-16b31ed4-f8fb-4749-b6fb-13a0e5e90a3a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.300231 May 18 15:01:14.762395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 363/707] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:14 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:14.786364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:14.787475 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:14.801342 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.805802 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.810020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.811279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.927120 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:14.935518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-35b1cbf6-1ddf-46e7-868d-cde07ea83f58 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1518 microversion: 2.1 time: 0.402293 May 18 15:01:14.945613 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 345/708] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:14 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1518 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:14.950544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:14.951301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:14.957627 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.958089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:14.958872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:14.959314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:15.123147 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:15.134330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:15.136784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:15.149377 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-086f3970-d849-4adc-9d1e-7b5bed1cf747 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1743 microversion: 2.20 time: 0.357610 May 18 15:01:15.150690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 364/709] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:14 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1743 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:15.255521 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:15.266644 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f363df30-ccde-460b-a406-afa97c553d85 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1555 microversion: 2.1 time: 0.319646 May 18 15:01:15.268038 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 346/710] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:14 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1555 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:15.362430 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-749e8e73-0b10-499a-aa4d-43433ad7d4a9 req-9ade9d3f-0b60-4a5a-acba-7c4913a675d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d158898-fe22-450d-8a03-33f781b6fa1f", "name": "network-vif-deleted", "tag": "13109190-8799-4d42-a04f-c61a209975be"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:15.378142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-749e8e73-0b10-499a-aa4d-43433ad7d4a9 req-9ade9d3f-0b60-4a5a-acba-7c4913a675d6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:15.384003 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-749e8e73-0b10-499a-aa4d-43433ad7d4a9 req-9ade9d3f-0b60-4a5a-acba-7c4913a675d6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:15.407695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-749e8e73-0b10-499a-aa4d-43433ad7d4a9 req-9ade9d3f-0b60-4a5a-acba-7c4913a675d6 service nova] Creating event network-vif-deleted:13109190-8799-4d42-a04f-c61a209975be for instance 1d158898-fe22-450d-8a03-33f781b6fa1f on hv-cinder-83998 May 18 15:01:15.418827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-749e8e73-0b10-499a-aa4d-43433ad7d4a9 req-9ade9d3f-0b60-4a5a-acba-7c4913a675d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060907 May 18 15:01:15.419581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 365/711] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:15.779194 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:15.780056 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:15.788145 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:15.788888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:15.793081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:15.793616 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:15.927258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:15.935098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7d451b3e-e2cf-4cfc-94b9-aaf340bd2390 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1363 microversion: 2.1 time: 0.159982 May 18 15:01:15.935652 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 347/712] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:15 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:15.953457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:15.954165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:15.960335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:15.961137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:15.961959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:15.962402 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.117244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:16.126142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5bec588f-217b-4379-933e-9039bf32ebc7 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.177269 May 18 15:01:16.127375 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 366/713] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:15 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:16.160394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:16.161564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:16.173211 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.173665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.174436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.175137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.284469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:16.285114 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:16.291693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.292124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.292923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.293355 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.324987 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.325431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.325880 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lazy-loading 'fault' on Instance uuid 1d158898-fe22-450d-8a03-33f781b6fa1f {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:01:16.339580 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:16.347821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:16.349354 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:16.350533 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-059c005c-174c-46a6-9122-99008ee2b6af tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.197387 May 18 15:01:16.352035 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 348/714] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:16 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:16.371475 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eed26f817524cc292be459f2aaa6f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51aa9f371a9c4b20bd52f8e251c80711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:16.373031 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:16.378098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d39ab2b2-07c7-4ff9-b1ae-2339fae551f8 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 200 len: 1348 microversion: 2.1 time: 0.097450 May 18 15:01:16.378658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 367/715] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:16 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:16.383900 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-bbb8d3f9-6559-4dbe-9273-349edd176157 req-e4ba7ae8-3f65-4464-a673-ceba1a366f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "name": "network-vif-plugged", "status": "completed", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:16.392132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-bbb8d3f9-6559-4dbe-9273-349edd176157 req-e4ba7ae8-3f65-4464-a673-ceba1a366f10 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.392576 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-bbb8d3f9-6559-4dbe-9273-349edd176157 req-e4ba7ae8-3f65-4464-a673-ceba1a366f10 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.404635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-bbb8d3f9-6559-4dbe-9273-349edd176157 req-e4ba7ae8-3f65-4464-a673-ceba1a366f10 service nova] Creating event network-vif-plugged:d65953ed-9d4b-4ed8-bdb3-b52cc90c0217 for instance b9394fe1-b670-4e51-b247-71558d6f56ca on hv-cinder-83998 May 18 15:01:16.409575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-bbb8d3f9-6559-4dbe-9273-349edd176157 req-e4ba7ae8-3f65-4464-a673-ceba1a366f10 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029367 May 18 15:01:16.410149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 349/716] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:16.953321 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:16.954295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:16.968142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.968975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:16.969997 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:16.970621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.139728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:17.144185 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:17.144911 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:17.152342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.152827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.153383 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-329e87ca-c562-467d-b6ba-4306c6371037 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1554 microversion: 2.1 time: 0.204940 May 18 15:01:17.153861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.165659 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.165880 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 368/717] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:16 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:17.173351 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:17.183996 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:17.184506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:17.204690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.213455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.214307 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.214748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.418834 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0e3e4635-3e62-443d-98ce-df118f9063b5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.252278 May 18 15:01:17.420156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 369/718] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 15:01:17 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:17.425893 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:17.427098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:17.428406 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:17.438469 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.439418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.440563 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.441252 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.448714 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a90f2f79-add5-4423-ab34-821e6a11bdec tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.309062 May 18 15:01:17.460360 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 350/719] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:17 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:17.473771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:17.474680 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] [instance: 1d158898-fe22-450d-8a03-33f781b6fa1f] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:17.490112 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.491031 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.492373 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:17.492839 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:17.519042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] HTTP exception thrown: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f could not be found. May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Request method failure captured: May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f HTTP/1.1 May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQmToqxVJ0qAcDu_IqrtjzJF-z4Lk4eJLv5vG3gWxqX8Sn7j4NW19yJD643JMggOMX0JqpL0UO-gJ_cPc-TUZShqDvlRSPpx0JP-mF05p_6nIpapb6yYgeyOPWSwqlDsVQVqxHqxboEbaQnCR7uj5_f3OuHJU40Y1L_5aw7oPnHrzkk May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 51aa9f371a9c4b20bd52f8e251c80711 May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-TestMinimumBasicScenario-595701846 May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:01:17.525369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51aa9f371a9c4b20bd52f8e251c80711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-TestMinimumBasicScenario-595701846 May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 51aa9f371a9c4b20bd52f8e251c80711 May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-TestMinimumBasicScenario-595701846 May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-TestMinimumBasicScenario-595701846-project May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 0eed26f817524cc292be459f2aaa6f6e May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-TestMinimumBasicScenario-595701846-project May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f could not be found. May 18 15:01:17.526923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '1d158898-fe22-450d-8a03-33f781b6fa1f'} May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f could not be found. May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:01:17.527726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f could not be found. May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f could not be found. May 18 15:01:17.529021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:01:17.533445 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Returning 404 to user: Instance 1d158898-fe22-450d-8a03-33f781b6fa1f could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:01:17.534330 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5817728f-13bc-4be4-bc1e-d1dd90417293 tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f" status: 404 len: 111 microversion: 2.1 time: 0.071988 May 18 15:01:17.535099 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 351/720] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:17 2022] GET /compute/v2.1/servers/1d158898-fe22-450d-8a03-33f781b6fa1f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:01:17.544270 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d569bf0e-1dcb-410d-8a39-9a9b2b1d39dd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] Calling method '.version_select at 0x7fa8a08f5670>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:17.607411 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d569bf0e-1dcb-410d-8a39-9a9b2b1d39dd tempest-TestMinimumBasicScenario-595701846 tempest-TestMinimumBasicScenario-595701846-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1712029918" status: 202 len: 0 microversion: 2.1 time: 0.066797 May 18 15:01:17.608811 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 352/721] 10.222.0.59 () {58 vars in 1271 bytes} [Wed May 18 15:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1712029918 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:01:17.875263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:17.884814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:17.886608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:17.888059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e3fba1ce-cd10-4a16-a619-a4526c75bbe5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.466269 May 18 15:01:17.888883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 370/722] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:17 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:18.469485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:18.471202 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:18.484259 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:18.485126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:18.486849 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:18.487653 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:18.755567 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:18.769323 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e23c063e-82c4-49dd-83b9-db31677bb53e tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.304338 May 18 15:01:18.770354 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 353/723] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:18 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:18.915635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:18.916561 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:18.928689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:18.930238 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:18.931271 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:18.931947 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:19.237163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-2f154bfb-ddce-443a-a6e6-d0deef3f01a2 req-10e836d3-570a-4b7f-bbf3-4640a68d8b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56dffbf3-4309-4b9f-992f-118a9d2b3563", "tag": "0ed1e1a7-57d4-4ca3-9a56-96e3e696207c"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:19.255961 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-2f154bfb-ddce-443a-a6e6-d0deef3f01a2 req-10e836d3-570a-4b7f-bbf3-4640a68d8b51 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:19.260368 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-2f154bfb-ddce-443a-a6e6-d0deef3f01a2 req-10e836d3-570a-4b7f-bbf3-4640a68d8b51 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:19.293676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-2f154bfb-ddce-443a-a6e6-d0deef3f01a2 req-10e836d3-570a-4b7f-bbf3-4640a68d8b51 service nova] Creating event network-changed:0ed1e1a7-57d4-4ca3-9a56-96e3e696207c for instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 on hv-cinder-83998 May 18 15:01:19.303046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-2f154bfb-ddce-443a-a6e6-d0deef3f01a2 req-10e836d3-570a-4b7f-bbf3-4640a68d8b51 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071951 May 18 15:01:19.305955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 354/724] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:19.345101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:19.361158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:19.364322 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:19.366351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-76281819-acf0-4dd5-b676-158537a8f72f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.454898 May 18 15:01:19.378331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 371/725] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:18 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:19.788404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:19.789137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:19.808424 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:19.808910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:19.809698 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:19.810142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:19.966334 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:19.975610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-742baf14-f6cf-46ce-93c2-ec6f5460a78d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.191890 May 18 15:01:19.977429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 355/726] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:19 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:20.383911 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:20.384522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:20.396452 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:20.396930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:20.398262 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:20.398706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:20.629505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:20.646531 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:20.653340 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:20.656038 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-83e27c1d-d5dd-4078-b7b5-fbefc64f4675 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.275305 May 18 15:01:20.671886 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 372/727] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:20 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:20.993695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:20.994960 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:21.002307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:21.002757 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:21.003531 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:21.004149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:21.231168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:21.239769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f64efdfc-97a4-4430-a710-4a9660d4d1db tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.249933 May 18 15:01:21.240695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 356/728] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:20 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:21.676782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:21.677990 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:21.685292 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:21.685960 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:21.686905 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:21.687503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:21.849204 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:21.862806 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:21.864600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:21.865922 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6ea2426d-a448-4dfe-8e46-19158a0783bd tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.193111 May 18 15:01:21.868106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 373/729] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:21 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:22.258190 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:22.258869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:22.270676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:22.271476 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:22.273625 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:22.274135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:22.444056 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:22.454200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1a62cd05-1a66-4288-a032-92d9bfc3c95f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.201301 May 18 15:01:22.456150 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 357/730] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:22 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:22.886057 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:22.887328 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:22.902148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:22.902952 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:22.903961 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:22.904700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:23.198139 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:23.216027 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:23.217580 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:23.219108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8ba92347-5e86-4ad9-b3e2-ccc15fd9dae9 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.337182 May 18 15:01:23.231860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 374/731] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:22 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:23.472775 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:23.473383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:23.482050 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:23.483301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:23.484855 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:23.485491 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:23.708677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:23.717545 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9d4f50ba-ef02-41e2-9b15-555fe603722f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.248510 May 18 15:01:23.718436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 358/732] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:23 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:24.239642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:24.241087 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:24.249503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:24.250265 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:24.251276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:24.251815 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:24.484182 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:24.494352 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:24.495780 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:24.497069 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-48bd3ca1-765f-4d3d-9b81-96a003f5f4b8 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.261659 May 18 15:01:24.512399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 375/733] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:24 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:24.735803 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:24.736482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:24.744025 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:24.744623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:24.745469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:24.745918 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:25.031199 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:25.044734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1930bf02-24c4-4d4d-949d-5e4aa1b10e4c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.313183 May 18 15:01:25.047803 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 359/734] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:24 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:25.514857 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:25.515630 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:25.523151 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:25.528015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:25.530683 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:25.532863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:25.723763 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:25.737573 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:25.739221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:25.740409 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bfb14aa7-2460-4bd8-afb2-69da9d90bfef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.229478 May 18 15:01:25.742748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 376/735] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:25 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:26.069172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:26.070821 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:26.082119 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:26.085993 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:26.087523 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:26.088275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:26.338033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:26.351779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c5e296ea-b0e1-46a0-b0df-e7fc9e2c0152 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.287732 May 18 15:01:26.363601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 360/736] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:26 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:26.758548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:26.762829 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:26.774226 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:26.777186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:26.781163 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:26.781857 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:27.018547 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:27.030774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:27.035045 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:27.037795 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0a3fb7aa-a495-4056-8126-025b8e6fd1f2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1738 microversion: 2.20 time: 0.283184 May 18 15:01:27.050244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 377/737] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:26 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:27.373845 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:27.374554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:27.385809 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:27.386274 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:27.387094 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:27.387540 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:27.561982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:27.571519 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-823d6622-931e-4c4f-a9b9-2f62b59a916a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.203520 May 18 15:01:27.575438 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 361/738] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:27 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:28.058252 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:28.059637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:28.067344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:28.068208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:28.069214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:28.070000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:28.185679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-e1fea177-5495-44f3-a202-e47d66d10100 req-ce734e26-3370-49e5-ac1d-61f1065d512c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "name": "network-vif-plugged", "status": "completed", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:28.198519 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e1fea177-5495-44f3-a202-e47d66d10100 req-ce734e26-3370-49e5-ac1d-61f1065d512c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:28.205593 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e1fea177-5495-44f3-a202-e47d66d10100 req-ce734e26-3370-49e5-ac1d-61f1065d512c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:28.225016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-e1fea177-5495-44f3-a202-e47d66d10100 req-ce734e26-3370-49e5-ac1d-61f1065d512c service nova] Creating event network-vif-plugged:85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb on hv-cinder-83998 May 18 15:01:28.231633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-e1fea177-5495-44f3-a202-e47d66d10100 req-ce734e26-3370-49e5-ac1d-61f1065d512c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049251 May 18 15:01:28.232215 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 362/739] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:01:28.248175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:28.256281 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:28.258108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:28.259762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6a6cf7f0-f03f-4105-a809-95fc24693305 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1720 microversion: 2.20 time: 0.206835 May 18 15:01:28.260819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 378/740] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:28 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:28.592800 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:28.593500 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:28.604702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:28.605011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:28.605779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:28.606210 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:28.737422 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:28.745008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4841d1d7-d54e-40d6-9541-137d91b0040a tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.157028 May 18 15:01:28.745568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 363/741] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:28 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:29.278641 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:29.279184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:29.281763 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:29.287010 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:29.287532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:29.288303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:29.288768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:29.515901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:29.524235 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:29.525850 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:29.527020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3891a986-27ae-46df-8c75-62501f7294c2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1720 microversion: 2.20 time: 0.252789 May 18 15:01:29.527578 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 379/742] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:29 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:29.762394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:29.763082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:29.770189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:29.770650 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:29.771433 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:29.771873 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:29.914231 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:29.922016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5cd355a6-4745-48e3-8b2b-62a48f5013ce tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.163701 May 18 15:01:29.922592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 364/743] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:29 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:30.545461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:30.546112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:30.553318 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:30.553867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:30.554905 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:30.555353 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:30.728669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:30.741195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:30.743690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:30.745448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0051aa38-2311-413d-bca0-62ad48601fef tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1720 microversion: 2.20 time: 0.204022 May 18 15:01:30.746606 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 380/744] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:30 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:30.939482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:30.940197 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:30.947975 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:30.948429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:30.949253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:30.949878 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:31.098634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:31.108535 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e103479d-09a4-4125-83f9-ed49ac2a24aa tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1574 microversion: 2.1 time: 0.172968 May 18 15:01:31.109279 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 365/745] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:30 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:01:31.765231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:31.766613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:31.773778 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:31.774610 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:31.775663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:31.776330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.127595 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:32.128191 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:32.140284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.140911 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.141797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.142450 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.179566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:32.196986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:32.199941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:32.201459 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3de5fd81-1586-4334-882c-ce5978228323 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1663 microversion: 2.20 time: 0.440331 May 18 15:01:32.217065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 381/746] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:31 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1663 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:32.226958 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a962d06b-6442-4197-b938-801c6284891f"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:32.228686 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:32.239901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.240608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.241851 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.243577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.450746 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:32.463906 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6c5fe628-8d9e-4b44-b744-7b41990e027c tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1561 microversion: 2.1 time: 0.341067 May 18 15:01:32.474859 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 366/747] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:01:32 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1561 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:01:32.474859 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-812be95c-4f8a-4d41-96cb-58ae5af2dadf req-7cb8152e-b680-435e-b45d-fafce28e182e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "name": "network-vif-unplugged", "status": "completed", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:32.484069 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-812be95c-4f8a-4d41-96cb-58ae5af2dadf req-7cb8152e-b680-435e-b45d-fafce28e182e service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.484613 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-812be95c-4f8a-4d41-96cb-58ae5af2dadf req-7cb8152e-b680-435e-b45d-fafce28e182e service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.499436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.compute.server_external_events [req-812be95c-4f8a-4d41-96cb-58ae5af2dadf req-7cb8152e-b680-435e-b45d-fafce28e182e service nova] Unable to find a host for instance b9394fe1-b670-4e51-b247-71558d6f56ca. Dropping event network-vif-unplugged {{(pid=123865) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 18 15:01:32.500491 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-812be95c-4f8a-4d41-96cb-58ae5af2dadf req-7cb8152e-b680-435e-b45d-fafce28e182e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034569 May 18 15:01:32.501249 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 367/748] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 15:01:32.615717 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:32.630514 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8beeaa3c-c7ed-40dd-9ed6-6821b1093cf1 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.411569 May 18 15:01:32.632395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 382/749] 10.222.0.59 () {62 vars in 1363 bytes} [Wed May 18 15:01:32 2022] POST /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-volume_attachments => generated 188 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 15:01:32.755248 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:32.756075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:32.763534 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.764179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:32.765052 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:32.765583 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:33.104555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:33.181793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-378a0d20-60e3-49a9-b64e-d969b4fdf99c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-volume_attachments/a962d06b-6442-4197-b938-801c6284891f" status: 202 len: 0 microversion: 2.20 time: 0.431754 May 18 15:01:33.182483 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 368/750] 10.222.0.59 () {60 vars in 1456 bytes} [Wed May 18 15:01:32 2022] DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-volume_attachments/a962d06b-6442-4197-b938-801c6284891f => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 15:01:33.252940 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:33.253487 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:33.261503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:33.265831 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:33.266709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:33.267157 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:33.372065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5160b54c-df62-4f33-8add-7485a959ed02 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "POST /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/action" status: 202 len: 0 microversion: 2.20 time: 0.123327 May 18 15:01:33.373046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 383/751] 10.222.0.59 () {62 vars in 1318 bytes} [Wed May 18 15:01:33 2022] POST /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 15:01:33.385193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:33.386370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:33.399449 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:33.400104 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:33.401158 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:33.402348 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:33.768573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:33.785969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:33.787511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:33.788843 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1e2d9b1d-e7ad-49b7-983f-479517753ac2 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1671 microversion: 2.20 time: 0.411572 May 18 15:01:33.789738 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 369/752] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:33 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1671 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:34.811014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:34.812843 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:34.820573 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:34.821443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:34.822875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:34.823658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:35.023061 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:35.031243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:35.033017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:35.034345 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-76f9297d-a6d1-4d32-a4fc-5e8524108930 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.231657 May 18 15:01:35.036700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 384/753] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:34 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:36.053395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:36.055394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:36.073296 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:36.073750 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:36.079376 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:36.079832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:36.324447 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:36.333561 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:36.335749 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:36.344423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2b814154-ce42-43b0-882a-28e508cb7c4c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.293857 May 18 15:01:36.347067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 370/754] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:36 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:37.367621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:37.368245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:37.379464 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:37.382279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:37.383522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:37.384422 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:37.929543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:37.958050 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:37.959598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:37.967202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3d78268c-7970-493e-8285-0fa5d63426db tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.604031 May 18 15:01:37.968319 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 385/755] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:37 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:38.989615 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:38.990462 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:39.013399 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:39.017359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:39.019734 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:39.021004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:39.591217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:39.608640 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:39.612138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:39.616686 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e52d9216-474e-4055-b0ef-b95d53d72090 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.632327 May 18 15:01:39.620932 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 371/756] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:38 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:40.637256 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:40.638490 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:40.651728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:40.654691 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:40.656294 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:40.658413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:40.999257 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:41.016501 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:41.018281 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:41.019499 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e4c71ff0-a31f-4373-9f8a-24be937bdcc5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.388433 May 18 15:01:41.025617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 386/757] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:40 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:41.651615 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f34a7df8-e9b5-417c-87a6-d80ab97100e8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Action: 'create', calling method: .version_select at 0x7fa8a0a7dd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1782896207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbDZp7unMV5RCaUlXE0cGVkIlyMmxC8cbF5NCxYAW3YTrv6gNlOQxC1pnA1gWqcougS9GH3xhC5NEJ0TdReqlSPvvHrW0NXRQWH54xSDD3fitcs2QdTMRQ03Dplp7qGgg=="}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:41.656479 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:41.669692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-f34a7df8-e9b5-417c-87a6-d80ab97100e8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:01:41.674230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-f34a7df8-e9b5-417c-87a6-d80ab97100e8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for user b1a4f9ee8de446fe989b4d91ea0315e8 and project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:01:41.698967 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f34a7df8-e9b5-417c-87a6-d80ab97100e8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.271810 May 18 15:01:41.699564 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 372/758] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 15:01:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:42.039420 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:42.040214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:42.050621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:42.051101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:42.051896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:42.052407 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:42.351174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:42.360765 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:42.362984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:42.364458 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a9c9bd6d-9c35-4d54-911c-a224c584ef20 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.330764 May 18 15:01:42.365200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 387/759] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:42 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:43.385780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:43.387297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:43.404861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:43.405324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:43.406118 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:43.406559 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:43.575431 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:43.587412 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:43.590083 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:43.591989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-cc3adfcc-7303-4863-a60d-c94d7fe4c5a7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.212389 May 18 15:01:43.603011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 373/760] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:43 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:44.610803 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:44.611434 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:44.618811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:44.619261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:44.620017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:44.620453 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:44.822039 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:44.831322 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:44.833160 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:44.835191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5381683d-0201-442c-bf99-d94f66a3bfb5 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.227741 May 18 15:01:44.846688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 388/761] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:44 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:45.855327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:45.856764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:45.863895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:45.864399 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:45.865202 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:45.865638 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:46.033208 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:46.046052 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:46.047839 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:46.049050 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-753ba77b-d27f-4d59-8791-7c287c0e8252 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.199266 May 18 15:01:46.050443 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 374/762] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:45 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:47.070195 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:47.070876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:47.077688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:47.078151 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:47.078947 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:47.079394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:47.226291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:47.235537 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:47.237100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:47.238289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4bd8c7f6-5d26-4c76-ae6b-8e0be6ff37c4 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.172765 May 18 15:01:47.244245 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 389/763] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:47 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:48.257779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:48.258367 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:48.264854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:48.265300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:48.266056 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:48.266536 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:48.401121 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:48.409899 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:48.411407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:48.412605 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-35280a70-b23d-41b3-b133-781165d03d09 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.159166 May 18 15:01:48.413176 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 375/764] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:48 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:49.432186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:49.432856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:49.439566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:49.440016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:49.440820 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:49.441501 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:49.570690 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:49.578504 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:49.580022 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:49.581222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e4259dbc-e2f0-4d60-a26f-444df78197df tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.154438 May 18 15:01:49.581786 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 390/765] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:49 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:50.599239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:50.599860 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:50.606884 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:50.607330 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:50.608124 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:50.608556 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:50.742601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:50.763155 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:50.764704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:50.765891 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-26fd04ed-435c-4d48-a28c-139ee7ce643d tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.170569 May 18 15:01:50.766451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 376/766] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:50 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:51.784613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:51.785243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:51.791917 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:51.792370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:51.793173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:51.793675 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:51.923510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:51.932930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:51.934489 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:51.935703 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bcc57cbd-478c-4960-a7c5-567bf8063032 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.155065 May 18 15:01:51.936271 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 391/767] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:51 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:52.211602 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-ff90a5f2-7185-4851-ad9c-e242a284ebe8 req-41672825-3229-4710-957e-0ed9f58e1cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "name": "network-vif-plugged", "status": "completed", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:52.215954 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=4 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:52.224205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-ff90a5f2-7185-4851-ad9c-e242a284ebe8 req-41672825-3229-4710-957e-0ed9f58e1cf7 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:52.224677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-ff90a5f2-7185-4851-ad9c-e242a284ebe8 req-41672825-3229-4710-957e-0ed9f58e1cf7 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:52.236801 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-ff90a5f2-7185-4851-ad9c-e242a284ebe8 req-41672825-3229-4710-957e-0ed9f58e1cf7 service nova] Creating event network-vif-plugged:d65953ed-9d4b-4ed8-bdb3-b52cc90c0217 for instance b9394fe1-b670-4e51-b247-71558d6f56ca on hv-cinder-83998 May 18 15:01:52.248614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-ff90a5f2-7185-4851-ad9c-e242a284ebe8 req-41672825-3229-4710-957e-0ed9f58e1cf7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035214 May 18 15:01:52.248614 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 377/768] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:52.954170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:52.954789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:52.961895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:52.962349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:52.963116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:52.963554 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:53.101754 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:53.110510 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:53.112171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:53.113988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2cb6b983-cc5b-485b-bc15-f1fe4eadda92 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.163504 May 18 15:01:53.115434 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 392/769] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:52 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 15:01:54.133735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:54.134425 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:54.141128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:54.141601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:54.142332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:54.142758 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:54.279586 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:54.287495 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:54.289052 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:54.290210 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-564e658f-4ae3-422c-8ed0-b9d6dac32c3c tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1729 microversion: 2.20 time: 0.160808 May 18 15:01:54.290773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 378/770] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:54 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:55.308157 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:55.308807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:55.315226 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:55.315679 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:55.316445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:55.316922 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:55.444261 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:55.452276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:55.453844 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:01:55.455014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0a8418f3-5b59-4962-a904-cd24257d858a tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1716 microversion: 2.20 time: 0.151724 May 18 15:01:55.455570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 393/771] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:01:55 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:01:58.541179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:01:58.541673 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:58.547623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:58.548329 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:58.548910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:58.549620 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:58.573696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-613b239e-ca38-431d-9e10-5da354e72129 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/ips" status: 200 len: 144 microversion: 2.1 time: 0.036767 May 18 15:01:58.574253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 379/772] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 15:01:58 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:01:59.516026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-676439946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782896207", "security_groups": [{"name": "tempest-secgroup-smoke-1025458164"}], "block_device_mapping_v2": [{"uuid": "0cc96036-4aa2-4d9f-9da6-255ca28a1756", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19da6af6-a529-4bd8-858e-9cc319b37384"}]}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:59.525367 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=32 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:59.625665 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] validate_networks() for [('19da6af6-a529-4bd8-858e-9cc319b37384', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:01:59.878810 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc0e85d7-14fb-4c0d-b90f-2896404108d7"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:01:59.879877 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:01:59.886924 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:59.887370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:01:59.888123 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:01:59.888555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:00.001052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:02:00.001514 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:02:00.001983 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:02:00.002426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:02:00.002876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:02:00.012532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:00.013181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:00.014000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:00.014457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:00.033145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:02:00.038660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for user b1a4f9ee8de446fe989b4d91ea0315e8 and project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:02:00.099790 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:02:00.102933 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cc96036-4aa2-4d9f-9da6-255ca28a1756',volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:02:00.170289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-78d55d43-a9f8-47c8-bdf5-36490c55c2ba tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295237 May 18 15:02:00.171178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 380/773] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:01:59 2022] POST /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:02:00.252688 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-24adbfa6-cca9-4105-aab3-1aac9b200c82 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740538 May 18 15:02:00.253580 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 394/774] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:01:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 15:02:00.264753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-dc3a1932-d902-4bf5-9855-7fd038d14ae8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:00.265453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-dc3a1932-d902-4bf5-9855-7fd038d14ae8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:00.324549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-dc3a1932-d902-4bf5-9855-7fd038d14ae8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:00.332612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-dc3a1932-d902-4bf5-9855-7fd038d14ae8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1094 microversion: 2.1 time: 0.072426 May 18 15:02:00.333392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 381/775] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:00 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:01.349639 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:01.351498 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:01.358556 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:01.359016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:01.359804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:01.360244 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:01.423825 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:01.433249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bf4ef2b9-397f-443e-81c7-6947aee31a39 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1200 microversion: 2.1 time: 0.088001 May 18 15:02:01.434082 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 395/776] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:01 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:02.450657 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:02.451275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:02.458494 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:02.458935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:02.460368 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:02.461429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:02.605767 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:02.613486 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5669a66c-ee30-4c3b-a5ee-e9e56d7f86c6 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1278 microversion: 2.1 time: 0.166639 May 18 15:02:02.625570 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 382/777] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:02 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:02.759594 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-ca2914f8-7273-42ab-85b5-741a84a859b5 req-17df7a27-e5da-4aca-a1f3-77a9bcb1b3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4414a5-96ca-43e6-beba-c0892c513802", "tag": "b4ed26f0-f48f-4f2f-8bf5-816859955580"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:02.769669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ca2914f8-7273-42ab-85b5-741a84a859b5 req-17df7a27-e5da-4aca-a1f3-77a9bcb1b3de service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:02.770247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ca2914f8-7273-42ab-85b5-741a84a859b5 req-17df7a27-e5da-4aca-a1f3-77a9bcb1b3de service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:02.788287 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-ca2914f8-7273-42ab-85b5-741a84a859b5 req-17df7a27-e5da-4aca-a1f3-77a9bcb1b3de service nova] Creating event network-changed:b4ed26f0-f48f-4f2f-8bf5-816859955580 for instance 2e4414a5-96ca-43e6-beba-c0892c513802 on hv-cinder-83998 May 18 15:02:02.793380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-ca2914f8-7273-42ab-85b5-741a84a859b5 req-17df7a27-e5da-4aca-a1f3-77a9bcb1b3de service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038880 May 18 15:02:02.793927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 396/778] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:03.087075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:03.087492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:03.093893 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:03.094344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:03.095111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:03.095551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:03.122664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-07eb91b5-1242-452b-9e6f-64781e611d7a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/ips" status: 200 len: 151 microversion: 2.1 time: 0.040571 May 18 15:02:03.123246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 383/779] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 15:02:03 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:03.633999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:03.634853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:03.641155 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:03.641611 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:03.642386 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:03.642826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:03.645492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:03.783964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:03.791479 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6b1f1def-54c8-4126-939f-08d0cf232396 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1278 microversion: 2.1 time: 0.162479 May 18 15:02:03.792058 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 397/780] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:03 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:04.513246 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8071049-b4f8-44dd-9772-ec1ddcb0a54c"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:04.514425 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:04.520991 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:04.521444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:04.522247 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:04.522684 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:04.525168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:04.773825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5e4640f2-28e5-4435-b88a-d45a7c883f99 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264270 May 18 15:02:04.774431 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 384/781] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:02:04 2022] POST /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:04.808604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:04.809850 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:04.816526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:04.817205 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:04.819197 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:04.819784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:04.957854 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:04.965879 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-19f4e980-9379-47f2-915d-ded657193f16 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1278 microversion: 2.1 time: 0.161560 May 18 15:02:04.966455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 398/782] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:04 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:05.987857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:05.988648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:05.997405 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:05.998221 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:05.999298 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:05.999743 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:06.132499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:06.139881 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3de134b8-8941-45a0-b3fe-02fa738472f1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1278 microversion: 2.1 time: 0.156749 May 18 15:02:06.140441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 385/783] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:05 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:07.159078 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:07.160069 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:07.166809 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:07.167963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:07.168840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:07.169299 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:07.316254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:07.324445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-617a13c0-8dae-4ddb-a5b8-ad20fc268133 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1278 microversion: 2.1 time: 0.170520 May 18 15:02:07.325041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 399/784] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:07 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:07.669348 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:07.670396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:07.677700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:07.678800 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:07.679566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:07.680267 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:07.710727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c76cd140-83b9-4b8a-a886-83544f9a1993 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 May 18 15:02:07.711302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 386/785] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:02:07 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:07.721243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:07.721747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:07.728613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:07.729152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:07.729958 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:07.730451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:07.764503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c7f668eb-7e86-41a1-951f-7d557281471f tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/dc0e85d7-14fb-4c0d-b90f-2896404108d7" status: 200 len: 194 microversion: 2.1 time: 0.047270 May 18 15:02:07.765123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 400/786] 10.222.0.59 () {58 vars in 1412 bytes} [Wed May 18 15:02:07 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/dc0e85d7-14fb-4c0d-b90f-2896404108d7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:08.340078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:08.340719 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:08.347179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:08.347627 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:08.348387 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:08.348850 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:08.486826 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:08.494902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5a0aa735-232c-4bb0-9db3-1dc00dd55124 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.158682 May 18 15:02:08.495458 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 387/787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:08 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:09.129532 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d75636c6-fb7a-4b29-bc34-76bd12bafd6e"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:09.130640 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:09.140284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:09.140783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:09.141572 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:09.142020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:09.397554 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4fb73939-919c-4f4b-8332-b449b379e849 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "POST /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272609 May 18 15:02:09.398152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 401/788] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:02:09 2022] POST /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:09.511781 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:09.512393 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:09.518863 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:09.519308 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:09.520062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:09.520493 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:09.651748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:09.659493 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ec290ad9-727e-4539-ae92-41e57215753e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.151817 May 18 15:02:09.660664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 388/789] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:09 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:10.677906 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:10.678616 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:10.681252 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:10.681913 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:10.688153 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:10.688623 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:10.689395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:10.689837 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:10.819033 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:10.826418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-71c8496e-df95-49d0-a06f-adacf9166de1 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.152960 May 18 15:02:10.826995 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 402/790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:10 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:11.844395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:11.844986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:11.846959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:11.848090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:11.854044 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:11.854499 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:11.855268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:11.855711 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:11.988067 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:11.995385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8299f125-3333-46f6-ba2f-1df5d5f27832 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.154941 May 18 15:02:11.995938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 389/791] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:11 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:13.011689 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:13.012304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:13.018979 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:13.019429 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:13.020193 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:13.020653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:13.151586 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:13.159230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d542683a-6582-4d64-8a54-28eae3f9a389 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.151426 May 18 15:02:13.159797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 403/792] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:13 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:14.177031 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:14.178268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:14.185155 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:14.185613 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:14.186381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:14.186823 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:14.317315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:14.325721 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-89dcdd27-ee3a-4bca-b01d-7e2a8b6224e4 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.152709 May 18 15:02:14.326612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 390/793] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:14 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:15.342523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:15.343134 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:15.349731 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:15.350254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:15.351016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:15.351449 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:15.465230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-041601ea-cda4-44e7-9de8-4d9adcfd69a5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: .version_select at 0x7fa8a0b1d3a0>, body: {"keypair": {"name": "tempest-keypair-734225090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNViWsSrrxd4LRqK7kzRYadVZXq6NlWkXdcRFi2phiONOpTksVGjUrz7cRv4DAZ8cc1KftDTv8ez/b4CyITQi0lJ+Ke2OaoCJ6NkarG1VhZyQNHmpzvgXM7Z2nHLs658eQ=="}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:15.480038 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-041601ea-cda4-44e7-9de8-4d9adcfd69a5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:02:15.484433 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-041601ea-cda4-44e7-9de8-4d9adcfd69a5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:02:15.507508 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-041601ea-cda4-44e7-9de8-4d9adcfd69a5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046039 May 18 15:02:15.508484 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 391/794] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 15:02:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:02:15.749860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:15.758392 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c3e41046-a0ae-4b1d-b64a-b9b9f0e8eb9c tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.419679 May 18 15:02:15.759020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 404/795] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:15 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:16.775138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:16.775911 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:16.782395 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:16.782897 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:16.783851 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:16.784730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:16.839140 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1471263363", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9022122f-bfa2-48d6-ae5d-8c609a059727"}], "security_groups": [{"name": "tempest-securitygroup--183189794"}], "key_name": "tempest-keypair-734225090", "user_data": "}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:16.951846 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:16.964472 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-79d2fec8-c0ab-4d96-ab0a-53fd8e4ec0f9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.193297 May 18 15:02:16.965529 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 392/796] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:16 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:16.977707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] validate_networks() for [('9022122f-bfa2-48d6-ae5d-8c609a059727', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:02:17.350550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:02:17.350967 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:02:17.351618 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:02:17.352046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:02:17.353663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:02:17.363653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:17.364099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:17.364924 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:17.365364 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:17.381301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:02:17.385094 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:02:17.395590 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:02:17.398331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:02:17.443598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-025523a8-a8eb-4f90-8af6-282b37fe06eb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.609346 May 18 15:02:17.444446 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 405/797] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:02:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 15:02:17.454297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-bf469b31-852a-42a2-adfc-6a540ddd5031 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:17.455016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-bf469b31-852a-42a2-adfc-6a540ddd5031 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:17.507716 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-bf469b31-852a-42a2-adfc-6a540ddd5031 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:17.514408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-bf469b31-852a-42a2-adfc-6a540ddd5031 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1241 microversion: 2.1 time: 0.064002 May 18 15:02:17.514970 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 393/798] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:17 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:17.982666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:17.983988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:17.993055 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:17.993758 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:17.994540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:17.994984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:18.129171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:18.137154 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b76673ee-a312-4e3c-8b54-a677e7c929a2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.159368 May 18 15:02:18.137731 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 406/799] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:17 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:18.340151 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-8544c2a6-7071-4e5d-951f-ee7a7f9fa9b2 req-e9bd6108-a0fd-433c-9f0c-8b98b0e0ae19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4414a5-96ca-43e6-beba-c0892c513802", "name": "network-vif-plugged", "status": "completed", "tag": "b4ed26f0-f48f-4f2f-8bf5-816859955580"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:18.350081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-8544c2a6-7071-4e5d-951f-ee7a7f9fa9b2 req-e9bd6108-a0fd-433c-9f0c-8b98b0e0ae19 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:18.350527 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-8544c2a6-7071-4e5d-951f-ee7a7f9fa9b2 req-e9bd6108-a0fd-433c-9f0c-8b98b0e0ae19 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:18.362726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-8544c2a6-7071-4e5d-951f-ee7a7f9fa9b2 req-e9bd6108-a0fd-433c-9f0c-8b98b0e0ae19 service nova] Creating event network-vif-plugged:b4ed26f0-f48f-4f2f-8bf5-816859955580 for instance 2e4414a5-96ca-43e6-beba-c0892c513802 on hv-cinder-83998 May 18 15:02:18.367837 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-8544c2a6-7071-4e5d-951f-ee7a7f9fa9b2 req-e9bd6108-a0fd-433c-9f0c-8b98b0e0ae19 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 May 18 15:02:18.368444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 394/800] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:18.533243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:18.534197 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:18.541171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:18.541747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:18.542796 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:18.543385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:18.629558 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:18.638365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6a59c81f-e8fc-45fb-b290-0e8efd50366e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1311 microversion: 2.1 time: 0.110935 May 18 15:02:18.639079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 407/801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:18 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:19.153911 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:19.154618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:19.160862 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:19.161548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:19.162822 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:19.163260 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:19.318675 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:19.328905 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-75294be0-0154-45b1-bb10-0eb5f25b721a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1266 microversion: 2.1 time: 0.178994 May 18 15:02:19.331036 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 395/802] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:19 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:02:19.655206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:19.655822 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:19.662926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:19.663374 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:19.664345 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:19.664860 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:19.803191 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:19.811078 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5aa5d169-c571-429c-8bb6-c3445434f4d5 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.159663 May 18 15:02:19.811923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 408/803] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:19 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:20.193925 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-e05fdc7e-f59a-4474-a362-03c731d293ed req-8f4255e8-81e9-42b9-becf-b5ceb2e50994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9d1e1f-5cbc-476f-9a19-2f7e41eed262", "tag": "0ff97e63-c16d-42f2-ad81-0d68433d904e"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:20.202575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e05fdc7e-f59a-4474-a362-03c731d293ed req-8f4255e8-81e9-42b9-becf-b5ceb2e50994 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.203025 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-e05fdc7e-f59a-4474-a362-03c731d293ed req-8f4255e8-81e9-42b9-becf-b5ceb2e50994 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:20.215712 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-e05fdc7e-f59a-4474-a362-03c731d293ed req-8f4255e8-81e9-42b9-becf-b5ceb2e50994 service nova] Creating event network-changed:0ff97e63-c16d-42f2-ad81-0d68433d904e for instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 on hv-cinder-83998 May 18 15:02:20.220717 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-e05fdc7e-f59a-4474-a362-03c731d293ed req-8f4255e8-81e9-42b9-becf-b5ceb2e50994 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031013 May 18 15:02:20.221515 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 396/804] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:20.347528 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:20.348449 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:20.355101 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.355922 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:20.356732 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.357171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:20.495849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:20.506381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7bb70155-9dc7-490d-b4ec-114210bb510e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1451 microversion: 2.1 time: 0.162574 May 18 15:02:20.506974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 409/805] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:20 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:20.523250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:20.524161 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:20.530383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.530833 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:20.531591 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.532020 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:20.671019 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:20.679224 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5a228ae7-2596-48e9-9d93-56cce1103221 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1451 microversion: 2.1 time: 0.160156 May 18 15:02:20.679784 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 397/806] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:20 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:02:20.829586 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:20.830220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:20.837206 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.837664 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:20.838545 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:20.838995 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:21.057462 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:21.065086 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-57040d6f-88ed-41cc-b75d-b891da23ad8f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.239321 May 18 15:02:21.065861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 410/807] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:20 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:22.081932 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:22.082644 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:22.089261 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.089786 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.090624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.091157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.330897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:22.331886 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:22.339104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.339558 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.340333 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.340804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.345629 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:22.354030 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-4c5ec6c8-e1b6-4c34-8ca1-fddd0090f9cf tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.276007 May 18 15:02:22.355201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 398/808] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:22 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:22.372167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ee320f79-4ffb-42f5-965c-69e615134fde tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045174 May 18 15:02:22.372755 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 411/809] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:02:22 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:02:22.512914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:22.513645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:22.519684 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.520216 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.521091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.522089 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.552175 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-560a128e-4354-4c6c-b737-246b730499f1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/dc0e85d7-14fb-4c0d-b90f-2896404108d7" status: 200 len: 194 microversion: 2.1 time: 0.043298 May 18 15:02:22.552964 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 399/810] 10.222.0.59 () {58 vars in 1412 bytes} [Wed May 18 15:02:22 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/dc0e85d7-14fb-4c0d-b90f-2896404108d7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:22.563827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:22.563827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:22.570128 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.570626 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.571848 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.572935 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.633802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-93199398-5457-43df-bcad-5ad3d6de0c1f req-0d25c0aa-733d-4107-95ac-017f4a737166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4414a5-96ca-43e6-beba-c0892c513802", "tag": "b4ed26f0-f48f-4f2f-8bf5-816859955580"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:22.642587 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-93199398-5457-43df-bcad-5ad3d6de0c1f req-0d25c0aa-733d-4107-95ac-017f4a737166 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:22.643346 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-93199398-5457-43df-bcad-5ad3d6de0c1f req-0d25c0aa-733d-4107-95ac-017f4a737166 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:22.656354 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-93199398-5457-43df-bcad-5ad3d6de0c1f req-0d25c0aa-733d-4107-95ac-017f4a737166 service nova] Creating event network-changed:b4ed26f0-f48f-4f2f-8bf5-816859955580 for instance 2e4414a5-96ca-43e6-beba-c0892c513802 on hv-cinder-83998 May 18 15:02:22.661336 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-93199398-5457-43df-bcad-5ad3d6de0c1f req-0d25c0aa-733d-4107-95ac-017f4a737166 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031848 May 18 15:02:22.662694 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 400/811] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:22.670609 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lazy-loading 'services' on Instance uuid f721eb0d-b804-41bd-ade4-95019478aef5 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:02:22.675612 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:22.749022 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b074c004-96fb-4936-9981-7c88d5431f63 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/dc0e85d7-14fb-4c0d-b90f-2896404108d7" status: 202 len: 0 microversion: 2.1 time: 0.189833 May 18 15:02:22.749618 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 412/812] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:02:22 2022] DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/dc0e85d7-14fb-4c0d-b90f-2896404108d7 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 15:02:23.372369 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:23.373105 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:23.379677 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:23.380286 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:23.381797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:23.382240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:23.520414 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:23.528332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d0fa11d4-bbed-44fb-bf46-9ea41f11bed7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.160585 May 18 15:02:23.538459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 401/813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:23 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:24.546680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:24.547388 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:24.554432 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:24.555129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:24.555910 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:24.556347 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:24.693276 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:24.700613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c3089f3c-00c1-410f-b930-797872854941 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.158727 May 18 15:02:24.701184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 413/814] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:24 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:24.918792 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:24.919396 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:24.926778 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:24.927236 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:24.928039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:24.928478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:24.956787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f474a0df-ff72-41fb-9491-9b6ef9eebc64 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/d75636c6-fb7a-4b29-bc34-76bd12bafd6e" status: 200 len: 194 microversion: 2.1 time: 0.042126 May 18 15:02:24.957359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 402/815] 10.222.0.59 () {58 vars in 1412 bytes} [Wed May 18 15:02:24 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/d75636c6-fb7a-4b29-bc34-76bd12bafd6e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:24.967939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:24.968434 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:24.974395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:24.974843 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:24.975604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:24.976041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:25.053756 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lazy-loading 'services' on Instance uuid f721eb0d-b804-41bd-ade4-95019478aef5 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:02:25.125022 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e1625972-7a97-4f67-9cf4-8ab409a130bf tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/d75636c6-fb7a-4b29-bc34-76bd12bafd6e" status: 202 len: 0 microversion: 2.1 time: 0.160900 May 18 15:02:25.125625 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 414/816] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:02:24 2022] DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments/d75636c6-fb7a-4b29-bc34-76bd12bafd6e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:02:25.719907 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:25.720520 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:25.726537 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:25.726986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:25.727753 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:25.728188 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:25.742651 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:25.859401 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:25.866964 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-bc4e1a22-3cd7-4973-ac91-a6cecec9480b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.152843 May 18 15:02:25.867524 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 403/817] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:25 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:26.287348 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:26.288434 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:26.294723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.295186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.295964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.296406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.328824 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e48625d6-0028-4096-9b8e-e3c90fd70874 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046265 May 18 15:02:26.329627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 415/818] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:02:26 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:02:26.430914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-084803ca-b62c-4051-86d7-2a02f827ffe8 req-5db1c1ff-9620-432c-9873-b036c2be8283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9d1e1f-5cbc-476f-9a19-2f7e41eed262", "name": "network-vif-plugged", "status": "completed", "tag": "0ff97e63-c16d-42f2-ad81-0d68433d904e"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:26.436850 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:26.438335 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:26.440113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-084803ca-b62c-4051-86d7-2a02f827ffe8 req-5db1c1ff-9620-432c-9873-b036c2be8283 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.440565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-084803ca-b62c-4051-86d7-2a02f827ffe8 req-5db1c1ff-9620-432c-9873-b036c2be8283 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.449210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.449698 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.450478 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.450932 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.453251 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-084803ca-b62c-4051-86d7-2a02f827ffe8 req-5db1c1ff-9620-432c-9873-b036c2be8283 service nova] Creating event network-vif-plugged:0ff97e63-c16d-42f2-ad81-0d68433d904e for instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 on hv-cinder-83998 May 18 15:02:26.458229 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-084803ca-b62c-4051-86d7-2a02f827ffe8 req-5db1c1ff-9620-432c-9873-b036c2be8283 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032387 May 18 15:02:26.458928 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 404/819] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:02:26.485540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-36c0ddf2-8f7f-48cc-b555-5083d097b03c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053579 May 18 15:02:26.486723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 416/820] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:02:26 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:02:26.559904 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:26.560569 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:26.567283 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.567814 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.568700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.569205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.594303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:02:26.671696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3f1bda91-46c6-4b12-956a-9309ad156537 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 204 len: 0 microversion: 2.1 time: 0.116002 May 18 15:02:26.672621 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 405/821] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:02:26 2022] DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:02:26.681889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:26.682512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:26.688609 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.689005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.689782 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.690227 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.823726 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:26.831300 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-909c6d10-1ec9-4c21-afef-37e21fcdc08c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1671 microversion: 2.1 time: 0.154459 May 18 15:02:26.831874 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 417/822] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:26 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:02:26.884006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:26.884737 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:26.890724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.891169 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:26.891924 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:26.892356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:27.025390 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:27.033135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f6ccc6d6-027b-4128-a1a6-ea1e336c5374 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.153136 May 18 15:02:27.033706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 406/823] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:26 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:27.849058 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:27.850236 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:27.854368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:27.855042 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:27.860151 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:27.860863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:27.861433 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:27.861881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:27.989267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:27.996726 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7bd47d24-87ad-408e-92bd-b3fa48eac0de tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1671 microversion: 2.1 time: 0.151592 May 18 15:02:27.997306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 418/824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:27 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:28.050137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:28.050780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:28.053184 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=6 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:28.059327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:28.059780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:28.060545 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:28.061006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:28.194003 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:28.201568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6805e495-2a97-4067-8529-5eaa48c5185a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.155203 May 18 15:02:28.202142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 407/825] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:28 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:29.014296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:29.014916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:29.024548 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:29.025075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:29.025852 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:29.026454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:29.155902 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:29.163560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-94a575a4-0317-4cac-bea1-86bc995a9888 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1671 microversion: 2.1 time: 0.153243 May 18 15:02:29.164131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 419/826] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:29 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:29.218491 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:29.219115 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:29.225655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:29.226107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:29.226886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:29.227323 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:29.360385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:29.368020 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-09290907-476d-45cb-8d1d-f5c03626ccdd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1366 microversion: 2.1 time: 0.153400 May 18 15:02:29.368758 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 408/827] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:29 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:29.975701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-65d64000-23eb-4f39-b808-806172332f8f req-611273e1-2b6b-40eb-bfe6-e0b575e5944f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f721eb0d-b804-41bd-ade4-95019478aef5", "name": "network-vif-deleted", "tag": "768c0e8a-8f7d-4532-b2e5-1defde7dd51c"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:29.983002 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:29.985718 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-65d64000-23eb-4f39-b808-806172332f8f req-611273e1-2b6b-40eb-bfe6-e0b575e5944f service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:29.986267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-65d64000-23eb-4f39-b808-806172332f8f req-611273e1-2b6b-40eb-bfe6-e0b575e5944f service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:29.998922 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-65d64000-23eb-4f39-b808-806172332f8f req-611273e1-2b6b-40eb-bfe6-e0b575e5944f service nova] Creating event network-vif-deleted:768c0e8a-8f7d-4532-b2e5-1defde7dd51c for instance f721eb0d-b804-41bd-ade4-95019478aef5 on hv-cinder-83998 May 18 15:02:30.003890 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-65d64000-23eb-4f39-b808-806172332f8f req-611273e1-2b6b-40eb-bfe6-e0b575e5944f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 May 18 15:02:30.005008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 420/828] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:30.180704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:30.181655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:30.196759 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.197229 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.198239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.198872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.236155 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.236836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.237132 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lazy-loading 'fault' on Instance uuid f721eb0d-b804-41bd-ade4-95019478aef5 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:02:30.277515 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c71f6ddf364c9baca69e459547ab02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a08f2c9b8b49f6a5de343bf8826601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:30.285174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7ae8e05a-6de2-4b9c-8b3a-810e7b93ef08 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 200 len: 1327 microversion: 2.1 time: 0.109301 May 18 15:02:30.285722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 409/829] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:30 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:30.386932 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:30.387549 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:30.394143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.394619 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.395404 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.395849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.533365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:30.541894 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1a9f44cb-ca1b-4437-9cd3-275594fdc688 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1556 microversion: 2.1 time: 0.160237 May 18 15:02:30.542477 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 421/830] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:30 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:30.559384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:30.559889 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:30.566815 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.567482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.568414 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:30.569584 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:30.655065 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-038b4fc3-5c77-4003-9ed6-83e32b6a894b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099766 May 18 15:02:30.655748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 410/831] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 15:02:30 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:31.303028 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:31.303833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:31.310166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:31.310622 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:31.311399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:31.311839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:31.325709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] HTTP exception thrown: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Request method failure captured: May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 HTTP/1.1 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlI4lsSYyCxifEimwgRH-6frduWxVqxyw2KKX68W_RJ1jYvXuSJtQdU2jeB5J7TNUamgpuKtW4gVKCflWNFpjSUTTxxCqz469Pu_fQuAgQTWLXrGUW-Ddr5dGlb9aD5DYm0AV3ir0b46CYxtMTNvHViH0Pp5kzulZqqoOPkeZmUe_8 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:31.327362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 88c71f6ddf364c9baca69e459547ab02 May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:31.329099 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'f721eb0d-b804-41bd-ade4-95019478aef5'} May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:31.329988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:31.331303 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:31.332460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Returning 404 to user: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:31.332460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f44e0abe-9f1d-4750-963a-5f516fa81cd1 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 404 len: 111 microversion: 2.1 time: 0.030168 May 18 15:02:31.332460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 422/832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:31 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:02:31.339697 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-bf8ca890-ee86-4818-8ca7-3948a58cc128 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '.version_select at 0x7fa8a0a7d040>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:31.357652 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-bf8ca890-ee86-4818-8ca7-3948a58cc128 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043148498" status: 202 len: 0 microversion: 2.1 time: 0.022774 May 18 15:02:31.358227 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 411/833] 10.222.0.59 () {58 vars in 1220 bytes} [Wed May 18 15:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043148498 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:02:31.949220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-0df49319-7a63-4891-8f05-cf4b6845b411 req-a3172074-9a3b-45cb-9fa9-c418ad35cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9d1e1f-5cbc-476f-9a19-2f7e41eed262", "tag": "0ff97e63-c16d-42f2-ad81-0d68433d904e"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:31.958470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-0df49319-7a63-4891-8f05-cf4b6845b411 req-a3172074-9a3b-45cb-9fa9-c418ad35cfa2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:31.959178 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-0df49319-7a63-4891-8f05-cf4b6845b411 req-a3172074-9a3b-45cb-9fa9-c418ad35cfa2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:31.974755 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-0df49319-7a63-4891-8f05-cf4b6845b411 req-a3172074-9a3b-45cb-9fa9-c418ad35cfa2 service nova] Creating event network-changed:0ff97e63-c16d-42f2-ad81-0d68433d904e for instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 on hv-cinder-83998 May 18 15:02:31.980506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-0df49319-7a63-4891-8f05-cf4b6845b411 req-a3172074-9a3b-45cb-9fa9-c418ad35cfa2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034913 May 18 15:02:31.981312 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 423/834] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:34.445648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:34.446579 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:34.453349 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.453793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.454548 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.454979 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.483241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-004f2129-5955-4e43-9c8b-a32d79f79d0f tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042689 May 18 15:02:34.483724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 412/835] 10.222.0.59 () {60 vars in 1342 bytes} [Wed May 18 15:02:34 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:34.535363 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:34.535956 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:34.542048 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:34.542310 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.542544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:34.542768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.543540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.543979 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.548535 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.549010 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.549759 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.550186 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.557426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] HTTP exception thrown: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Request method failure captured: May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 HTTP/1.1 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlI4lsSYyCxifEimwgRH-6frduWxVqxyw2KKX68W_RJ1jYvXuSJtQdU2jeB5J7TNUamgpuKtW4gVKCflWNFpjSUTTxxCqz469Pu_fQuAgQTWLXrGUW-Ddr5dGlb9aD5DYm0AV3ir0b46CYxtMTNvHViH0Pp5kzulZqqoOPkeZmUe_8 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:34.559116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 88c71f6ddf364c9baca69e459547ab02 May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.560719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'f721eb0d-b804-41bd-ade4-95019478aef5'} May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:34.561632 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.563068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.564506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Returning 404 to user: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:34.564506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d84a60d7-bb0e-41db-8c19-c10d9caf9673 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 404 len: 111 microversion: 2.1 time: 0.029853 May 18 15:02:34.564506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 424/836] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:02:34 2022] DELETE /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:02:34.569622 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:34.570227 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: f721eb0d-b804-41bd-ade4-95019478aef5] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:34.576161 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.576639 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.577418 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.577862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.581068 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:02:34.592212 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] HTTP exception thrown: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Request method failure captured: May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 HTTP/1.1 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlI4lsSYyCxifEimwgRH-6frduWxVqxyw2KKX68W_RJ1jYvXuSJtQdU2jeB5J7TNUamgpuKtW4gVKCflWNFpjSUTTxxCqz469Pu_fQuAgQTWLXrGUW-Ddr5dGlb9aD5DYm0AV3ir0b46CYxtMTNvHViH0Pp5kzulZqqoOPkeZmUe_8 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:34.593762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 88c71f6ddf364c9baca69e459547ab02 May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.595362 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'f721eb0d-b804-41bd-ade4-95019478aef5'} May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:34.596172 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. May 18 15:02:34.597694 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:34.598994 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Returning 404 to user: Instance f721eb0d-b804-41bd-ade4-95019478aef5 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:34.598994 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e8118bcf-584a-48af-8e9c-eed58489db0c tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5" status: 404 len: 111 microversion: 2.1 time: 0.029674 May 18 15:02:34.598994 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 425/837] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:34 2022] GET /compute/v2.1/servers/f721eb0d-b804-41bd-ade4-95019478aef5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:02:34.667008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-71fbb05e-f80d-4546-9345-d6faa04ebf05 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 204 len: 0 microversion: 2.20 time: 0.128328 May 18 15:02:34.668090 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 413/838] 10.222.0.59 () {60 vars in 1279 bytes} [Wed May 18 15:02:34 2022] DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 18 15:02:34.677797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:34.679052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:34.687999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.688455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.689266 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:34.689712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:34.819203 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:34.827085 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:34.828637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:34.829811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b974e8f6-0e77-4bf6-94e1-ba29481ebd46 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.156971 May 18 15:02:34.830368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 426/839] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:02:34 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:02:35.730849 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:35.731436 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:35.737984 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:35.738441 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:35.739205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:35.739647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:35.753318 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] HTTP exception thrown: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Request method failure captured: May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab HTTP/1.1 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQlI4lsSYyCxifEimwgRH-6frduWxVqxyw2KKX68W_RJ1jYvXuSJtQdU2jeB5J7TNUamgpuKtW4gVKCflWNFpjSUTTxxCqz469Pu_fQuAgQTWLXrGUW-Ddr5dGlb9aD5DYm0AV3ir0b46CYxtMTNvHViH0Pp5kzulZqqoOPkeZmUe_8 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:02:35.754937 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 88c71f6ddf364c9baca69e459547ab02 May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.757189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'ee7efce9-bda4-4d05-a813-164f962babab'} May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:35.758193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.759655 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:35.761314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Returning 404 to user: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:35.761314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-42acd805-0e90-4b86-a5f9-ee4e998bc08d tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 404 len: 111 microversion: 2.1 time: 0.029763 May 18 15:02:35.761314 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 414/840] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:02:35 2022] DELETE /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:02:35.765164 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:35.765787 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] [instance: ee7efce9-bda4-4d05-a813-164f962babab] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:35.772304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:35.772800 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:35.773569 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:35.774012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:35.787017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] HTTP exception thrown: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Request method failure captured: May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab HTTP/1.1 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlI4lsSYyCxifEimwgRH-6frduWxVqxyw2KKX68W_RJ1jYvXuSJtQdU2jeB5J7TNUamgpuKtW4gVKCflWNFpjSUTTxxCqz469Pu_fQuAgQTWLXrGUW-Ddr5dGlb9aD5DYm0AV3ir0b46CYxtMTNvHViH0Pp5kzulZqqoOPkeZmUe_8 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:35.788538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9a08f2c9b8b49f6a5de343bf8826601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: c9a08f2c9b8b49f6a5de343bf8826601 May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717291894 May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 88c71f6ddf364c9baca69e459547ab02 May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeTestJSON-1717291894-project May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.790166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'ee7efce9-bda4-4d05-a813-164f962babab'} May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:35.791179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. May 18 15:02:35.792636 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:35.794012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] Returning 404 to user: Instance ee7efce9-bda4-4d05-a813-164f962babab could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:35.794012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2c77fe46-af96-469b-841a-0a4ff5ff3710 tempest-AttachVolumeTestJSON-1717291894 tempest-AttachVolumeTestJSON-1717291894-project] 10.222.0.59 "GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab" status: 404 len: 111 microversion: 2.1 time: 0.028580 May 18 15:02:35.794012 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 427/841] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:35 2022] GET /compute/v2.1/servers/ee7efce9-bda4-4d05-a813-164f962babab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 15:02:35.849311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:35.850790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:35.856902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:35.857356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:35.858124 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:35.858566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:36.074161 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:36.082107 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:36.083660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:36.084861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8a69a5d9-90d6-49d3-9858-27a303622787 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1722 microversion: 2.20 time: 0.240298 May 18 15:02:36.085426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 415/842] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:02:35 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:02:37.103556 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:37.104962 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:37.111834 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:37.112549 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:37.113350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:37.113787 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:37.185975 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-1cf6ef34-57b1-4f48-a809-3452e2db0916 req-2959724e-d982-47d2-b641-6d2bf236cdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9394fe1-b670-4e51-b247-71558d6f56ca", "name": "network-vif-deleted", "tag": "d65953ed-9d4b-4ed8-bdb3-b52cc90c0217"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:37.206699 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1cf6ef34-57b1-4f48-a809-3452e2db0916 req-2959724e-d982-47d2-b641-6d2bf236cdbe service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:37.207509 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1cf6ef34-57b1-4f48-a809-3452e2db0916 req-2959724e-d982-47d2-b641-6d2bf236cdbe service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:37.228766 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:37.240186 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:37.244121 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25784e3193b047ecaa6788bd79611f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:37.245367 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5216335a-5695-4aef-be38-64f2f308193e tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 200 len: 1655 microversion: 2.20 time: 0.146527 May 18 15:02:37.257965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-1cf6ef34-57b1-4f48-a809-3452e2db0916 req-2959724e-d982-47d2-b641-6d2bf236cdbe service nova] Creating event network-vif-deleted:d65953ed-9d4b-4ed8-bdb3-b52cc90c0217 for instance b9394fe1-b670-4e51-b247-71558d6f56ca on hv-cinder-83998 May 18 15:02:37.261655 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 428/843] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:02:37 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 15:02:37.263313 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-1cf6ef34-57b1-4f48-a809-3452e2db0916 req-2959724e-d982-47d2-b641-6d2bf236cdbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080872 May 18 15:02:37.263868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 416/844] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:38.263264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:38.263880 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:38.270641 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:38.271092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:38.272426 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:38.272881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:38.286921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] HTTP exception thrown: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Request method failure captured: May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca HTTP/1.1 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjwcxC48mOuVnDFLntKeAestmjUyTrXmQ7pjI_7S8QLBTdGG30lwqKPKLoqfybCSAWBPPAuN4b_ePB3hHYZN2FrXWg8CdbQenA8C_Ksti4eG0zxm-pWiMUkQleiDpc_AttdsF_7EnkqgjL0MiW6q8_6xiFQ0zFKIag9I_sJkE4RGj8 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Openstack-Nova-Api-Version: 2.20 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:38.289026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 25784e3193b047ecaa6788bd79611f3f May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:38.290394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'b9394fe1-b670-4e51-b247-71558d6f56ca'} May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:38.291159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:38.292337 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:38.295145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Returning 404 to user: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:38.296041 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a4514c69-2195-4bb9-b65b-412987f3c2e3 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 404 len: 111 microversion: 2.20 time: 0.036709 May 18 15:02:38.296642 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 429/845] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:02:38 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 15:02:38.306532 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5f65f2fd-c19a-47e7-ad47-a4de5cf799e7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '.version_select at 0x7fa8a0a81dc0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:38.344667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5f65f2fd-c19a-47e7-ad47-a4de5cf799e7 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544099451" status: 204 len: 0 microversion: 2.20 time: 0.043168 May 18 15:02:38.345450 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 417/846] 10.222.0.59 () {60 vars in 1261 bytes} [Wed May 18 15:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544099451 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 15:02:40.481023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:40.481637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:40.489287 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:40.489814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:40.491257 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:40.491769 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:40.506944 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] HTTP exception thrown: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Request method failure captured: May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca HTTP/1.1 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjwcxC48mOuVnDFLntKeAestmjUyTrXmQ7pjI_7S8QLBTdGG30lwqKPKLoqfybCSAWBPPAuN4b_ePB3hHYZN2FrXWg8CdbQenA8C_Ksti4eG0zxm-pWiMUkQleiDpc_AttdsF_7EnkqgjL0MiW6q8_6xiFQ0zFKIag9I_sJkE4RGj8 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Openstack-Nova-Api-Version: 2.20 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:40.508512 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 25784e3193b047ecaa6788bd79611f3f May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.510167 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'b9394fe1-b670-4e51-b247-71558d6f56ca'} May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:40.511711 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.513542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:40.515463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Returning 404 to user: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:40.515463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2c0a4724-8aa1-4459-a0a7-bb2a1728f623 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 404 len: 111 microversion: 2.20 time: 0.033168 May 18 15:02:40.515463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 430/847] 10.222.0.59 () {60 vars in 1279 bytes} [Wed May 18 15:02:40 2022] DELETE /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 15:02:40.519257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:40.519982 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: b9394fe1-b670-4e51-b247-71558d6f56ca] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:40.526986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:40.527429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:40.528189 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:40.528647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:40.542489 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] HTTP exception thrown: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Request method failure captured: May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca HTTP/1.1 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjwcxC48mOuVnDFLntKeAestmjUyTrXmQ7pjI_7S8QLBTdGG30lwqKPKLoqfybCSAWBPPAuN4b_ePB3hHYZN2FrXWg8CdbQenA8C_Ksti4eG0zxm-pWiMUkQleiDpc_AttdsF_7EnkqgjL0MiW6q8_6xiFQ0zFKIag9I_sJkE4RGj8 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Openstack-Nova-Api-Version: 2.20 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:02:40.544321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 25784e3193b047ecaa6788bd79611f3f May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.546033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'b9394fe1-b670-4e51-b247-71558d6f56ca'} May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:40.546796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. May 18 15:02:40.547988 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:40.549091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Returning 404 to user: Instance b9394fe1-b670-4e51-b247-71558d6f56ca could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:40.549091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6f5ed1c9-9fcb-439a-a31b-c20ce1b094e0 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca" status: 404 len: 111 microversion: 2.20 time: 0.030318 May 18 15:02:40.549091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 418/848] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:02:40 2022] GET /compute/v2.1/servers/b9394fe1-b670-4e51-b247-71558d6f56ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 18 15:02:41.681885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:41.682378 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:41.688747 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:41.689189 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:41.689941 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:41.690370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:41.703445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] HTTP exception thrown: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Request method failure captured: May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 HTTP/1.1 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQjwcxC48mOuVnDFLntKeAestmjUyTrXmQ7pjI_7S8QLBTdGG30lwqKPKLoqfybCSAWBPPAuN4b_ePB3hHYZN2FrXWg8CdbQenA8C_Ksti4eG0zxm-pWiMUkQleiDpc_AttdsF_7EnkqgjL0MiW6q8_6xiFQ0zFKIag9I_sJkE4RGj8 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Openstack-Nova-Api-Version: 2.20 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:41.705015 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: 25784e3193b047ecaa6788bd79611f3f May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.706774 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '5cf9b2c2-1694-4695-8c54-940340452792'} May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:41.707571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.708810 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:41.710570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Returning 404 to user: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:41.710570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-32e189d3-1cd2-410d-b431-eea5e1cf0629 tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 404 len: 111 microversion: 2.20 time: 0.028649 May 18 15:02:41.710570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 431/849] 10.222.0.59 () {60 vars in 1279 bytes} [Wed May 18 15:02:41 2022] DELETE /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 15:02:41.715232 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:41.715883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] [instance: 5cf9b2c2-1694-4695-8c54-940340452792] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:41.722337 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:41.722790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:41.723555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:41.723997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:41.737424 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] HTTP exception thrown: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Request method failure captured: May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 HTTP/1.1 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQjwcxC48mOuVnDFLntKeAestmjUyTrXmQ7pjI_7S8QLBTdGG30lwqKPKLoqfybCSAWBPPAuN4b_ePB3hHYZN2FrXWg8CdbQenA8C_Ksti4eG0zxm-pWiMUkQleiDpc_AttdsF_7EnkqgjL0MiW6q8_6xiFQ0zFKIag9I_sJkE4RGj8 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Openstack-Nova-Api-Version: 2.20 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:02:41.738935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9c46dc2b21d34158bf2a7eb0e39c06a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 9c46dc2b21d34158bf2a7eb0e39c06a3 May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-351182998 May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: 25784e3193b047ecaa6788bd79611f3f May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-351182998-project May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.740647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '5cf9b2c2-1694-4695-8c54-940340452792'} May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:41.741457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. May 18 15:02:41.742676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:02:41.743738 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] Returning 404 to user: Instance 5cf9b2c2-1694-4695-8c54-940340452792 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:41.743738 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-65a1b22d-c3be-44b0-b5c1-3ab47b0180fc tempest-AttachVolumeShelveTestJSON-351182998 tempest-AttachVolumeShelveTestJSON-351182998-project] 10.222.0.59 "GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792" status: 404 len: 111 microversion: 2.20 time: 0.029007 May 18 15:02:41.743738 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 419/850] 10.222.0.59 () {60 vars in 1276 bytes} [Wed May 18 15:02:41 2022] GET /compute/v2.1/servers/5cf9b2c2-1694-4695-8c54-940340452792 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 15:02:41.915054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-594bd88e-8770-453a-b9b0-55871b6b78dd tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a094b280>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:41.963107 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-594bd88e-8770-453a-b9b0-55871b6b78dd tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/1a90d7ee-7f06-4736-b73f-7268f8933e17" status: 200 len: 350 microversion: 2.1 time: 0.051964 May 18 15:02:41.963677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 432/851] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 15:02:41 2022] GET /compute/v2.1/os-volumes/1a90d7ee-7f06-4736-b73f-7268f8933e17 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:43.306229 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-02199b79-51ed-4a77-8db1-86b08b2c2182 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0b344c0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:43.361688 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-02199b79-51ed-4a77-8db1-86b08b2c2182 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71a63c3a-2ca3-487d-8a91-a649643f0ea7" status: 200 len: 350 microversion: 2.1 time: 0.059988 May 18 15:02:43.362257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 420/852] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 15:02:43 2022] GET /compute/v2.1/os-volumes/71a63c3a-2ca3-487d-8a91-a649643f0ea7 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:44.717146 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c533ed20-ab2e-429d-b7a7-ad1ee547f71e tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a07bad30>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:44.780790 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c533ed20-ab2e-429d-b7a7-ad1ee547f71e tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/25473d1b-0aff-49bf-961c-6f7f70872e7f" status: 200 len: 351 microversion: 2.1 time: 0.068258 May 18 15:02:44.783302 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 433/853] 10.222.0.59 () {58 vars in 1244 bytes} [Wed May 18 15:02:44 2022] GET /compute/v2.1/os-volumes/25473d1b-0aff-49bf-961c-6f7f70872e7f => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:44.793394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-02b3e67e-fb62-46d4-9ee1-73f4295e8981 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0916b80>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:44.887212 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-02b3e67e-fb62-46d4-9ee1-73f4295e8981 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098141 May 18 15:02:44.887787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 421/854] 10.222.0.59 () {58 vars in 1133 bytes} [Wed May 18 15:02:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:44.900536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-54d002be-ead2-4b3f-99b3-1a68e1dde4bb tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0b124c0>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:44.995443 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-54d002be-ead2-4b3f-99b3-1a68e1dde4bb tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098689 May 18 15:02:44.996080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 434/855] 10.222.0.59 () {58 vars in 1148 bytes} [Wed May 18 15:02:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:45.007623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1e08ad5c-ce5a-4e3a-861a-8dedeff145db tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0a125e0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:45.115178 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1e08ad5c-ce5a-4e3a-861a-8dedeff145db tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.111212 May 18 15:02:45.117126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 422/856] 10.222.0.59 () {58 vars in 1133 bytes} [Wed May 18 15:02:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:45.128354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4f334034-57f5-4f16-bc3d-c38882d9949e tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a094b4c0>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:45.212088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4f334034-57f5-4f16-bc3d-c38882d9949e tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087851 May 18 15:02:45.212677 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 435/857] 10.222.0.59 () {58 vars in 1166 bytes} [Wed May 18 15:02:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:45.224172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-60f072d4-a879-4f0e-b0ad-9915fbb87da9 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0a35550>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:45.309140 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-60f072d4-a879-4f0e-b0ad-9915fbb87da9 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088789 May 18 15:02:45.309710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 423/858] 10.222.0.59 () {58 vars in 1169 bytes} [Wed May 18 15:02:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:02:45.321394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3f4e055d-4d73-4483-a57c-7639680d44aa tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a07ba940>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:45.415808 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3f4e055d-4d73-4483-a57c-7639680d44aa tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098135 May 18 15:02:45.416413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 436/859] 10.222.0.59 () {58 vars in 1154 bytes} [Wed May 18 15:02:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:45.427552 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a7edbca2-bf9b-4aa3-9b6c-528914cf7278 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0b34940>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:45.515239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a7edbca2-bf9b-4aa3-9b6c-528914cf7278 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091415 May 18 15:02:45.515801 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 424/860] 10.222.0.59 () {58 vars in 1187 bytes} [Wed May 18 15:02:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:45.527645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0f5ff9db-9dfa-46fe-8cb8-3bb9805eb8e6 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] Calling method '.version_select at 0x7fa8a0b4bd30>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:45.611190 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0f5ff9db-9dfa-46fe-8cb8-3bb9805eb8e6 tempest-VolumesTestJSON-2310512 tempest-VolumesTestJSON-2310512-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087253 May 18 15:02:45.611963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 437/861] 10.222.0.59 () {58 vars in 1154 bytes} [Wed May 18 15:02:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:55.856936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:55.857834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:55.858876 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=23 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:55.859767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:55.862601 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:55.863177 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:55.864963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-f18dd223-e6a7-4be9-9617-cead06dbf7af req-f135fb6f-c417-4fbc-9011-6e5fd8d7b441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:55.877299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:55.877299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:55.877473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f18dd223-e6a7-4be9-9617-cead06dbf7af req-f135fb6f-c417-4fbc-9011-6e5fd8d7b441 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:55.877567 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:55.877662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-f18dd223-e6a7-4be9-9617-cead06dbf7af req-f135fb6f-c417-4fbc-9011-6e5fd8d7b441 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:55.877743 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:55.893455 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-f18dd223-e6a7-4be9-9617-cead06dbf7af req-f135fb6f-c417-4fbc-9011-6e5fd8d7b441 service nova] Creating event network-changed:85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb on hv-cinder-83998 May 18 15:02:55.901350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-f18dd223-e6a7-4be9-9617-cead06dbf7af req-f135fb6f-c417-4fbc-9011-6e5fd8d7b441 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044290 May 18 15:02:55.902255 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 438/862] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:02:55.934993 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:02:56.048995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-bf11c5c8-40f3-4694-891e-d2211a4341c3 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 204 len: 0 microversion: 2.1 time: 0.193379 May 18 15:02:56.050584 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 425/863] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:02:55 2022] DELETE /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:02:56.062109 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:56.063564 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:56.084926 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:56.085796 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:56.087444 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:56.088234 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:56.264247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:56.276383 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-37de70cf-e781-4fa1-842d-6c4da528ffe2 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.221090 May 18 15:02:56.287540 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 439/864] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:56 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:57.296832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:57.297535 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:57.305981 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:57.306826 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:57.308522 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:57.309213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:57.514212 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:57.528656 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3cf0391f-f8db-4f1f-9109-73c4b7962f93 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1567 microversion: 2.1 time: 0.236948 May 18 15:02:57.530975 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 426/865] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:57 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:58.450731 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-bb051fb6-9da1-4574-b6b2-2d360a8089a1 req-1a4ee494-4844-4bda-be21-4142a2268d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69b24f-4d86-449b-897d-ebf6e2ac43fb", "name": "network-vif-deleted", "tag": "85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:02:58.465213 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-bb051fb6-9da1-4574-b6b2-2d360a8089a1 req-1a4ee494-4844-4bda-be21-4142a2268d16 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:58.466063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-bb051fb6-9da1-4574-b6b2-2d360a8089a1 req-1a4ee494-4844-4bda-be21-4142a2268d16 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:58.478983 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-bb051fb6-9da1-4574-b6b2-2d360a8089a1 req-1a4ee494-4844-4bda-be21-4142a2268d16 service nova] Creating event network-vif-deleted:85c6e8e1-a7f5-4048-8ce6-ea9bd315a14d for instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb on hv-cinder-83998 May 18 15:02:58.484391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-bb051fb6-9da1-4574-b6b2-2d360a8089a1 req-1a4ee494-4844-4bda-be21-4142a2268d16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037521 May 18 15:02:58.485166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 440/866] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:02:58.548847 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:58.549633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:58.557705 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:58.559010 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:58.559810 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:58.560250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:58.624169 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0569d0a7641a9858c0810219b1ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379bba80af244096abbf8deb82772854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:02:58.632138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9f370053-0317-4482-ac69-8aaa99853d5f tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 200 len: 1218 microversion: 2.1 time: 0.087595 May 18 15:02:58.632776 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 427/867] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:58 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:02:59.649086 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:59.649872 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] [instance: 2c69b24f-4d86-449b-897d-ebf6e2ac43fb] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:02:59.656996 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:59.657531 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:59.658380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:02:59.658826 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:02:59.673000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] HTTP exception thrown: Instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb could not be found. May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Request method failure captured: May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb HTTP/1.1 May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQlhHwM9k8OuCtTw8ho9SATNzl9_TzOLPv66FrwOGOsWMheZEGb-usGVNDcCMSVn0CBC9FjFSf6i0sH8MVmSaPO0rVoAL3BHASrt7pWvg2fAhZ2QV4Qz8mHyjb3Pq7tjJ_JNSm2u-zV1Y7q7lvsGvHPx2PIU78cAc_-CRoOJnUktZFQ May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 379bba80af244096abbf8deb82772854 May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-TestShelveInstance-1298987999 May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:02:59.675095 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/379bba80af244096abbf8deb82772854"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/379bba80af244096abbf8deb82772854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/379bba80af244096abbf8deb82772854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_379bba80af244096abbf8deb82772854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-TestShelveInstance-1298987999 May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 379bba80af244096abbf8deb82772854 May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-TestShelveInstance-1298987999 May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-TestShelveInstance-1298987999-project May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: c9a0569d0a7641a9858c0810219b1ef8 May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-TestShelveInstance-1298987999-project May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb could not be found. May 18 15:02:59.676502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '2c69b24f-4d86-449b-897d-ebf6e2ac43fb'} May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb could not be found. May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:02:59.677892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb could not be found. May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb could not be found. May 18 15:02:59.679219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:02:59.680678 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Returning 404 to user: Instance 2c69b24f-4d86-449b-897d-ebf6e2ac43fb could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:02:59.680678 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7a2e7cdd-6cf3-4ea7-9569-250b940f389d tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb" status: 404 len: 111 microversion: 2.1 time: 0.031623 May 18 15:02:59.681928 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 441/868] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:02:59 2022] GET /compute/v2.1/servers/2c69b24f-4d86-449b-897d-ebf6e2ac43fb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:02:59.859957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1e066b58-06ed-48a9-afc8-185099abcba6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] Calling method '.version_select at 0x7fa8a0a9f4c0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:02:59.885287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1e066b58-06ed-48a9-afc8-185099abcba6 tempest-TestShelveInstance-1298987999 tempest-TestShelveInstance-1298987999-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-658147559" status: 202 len: 0 microversion: 2.1 time: 0.029972 May 18 15:02:59.888004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 428/869] 10.222.0.59 () {58 vars in 1250 bytes} [Wed May 18 15:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-658147559 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 15:03:08.607881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:08.608419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:08.615165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.615613 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.616383 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.616842 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.640343 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-bfb4aaa1-3c90-4092-98b5-6289172bc804 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/ips" status: 200 len: 150 microversion: 2.1 time: 0.036297 May 18 15:03:08.640952 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 442/870] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 15:03:08 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:08.649504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:08.653936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8071049-b4f8-44dd-9772-ec1ddcb0a54c"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:08.655025 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:08.663374 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.663827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.664663 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.665101 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.745165 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Invalid volume: volume c8071049-b4f8-44dd-9772-ec1ddcb0a54c is already attached to instances: 56dffbf3-4309-4b9f-992f-118a9d2b3563 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: POST /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/os-volume_attachments HTTP/1.1 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 74 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:03:08.746938 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {"volumeAttachment": {"volumeId": "c8071049-b4f8-44dd-9772-ec1ddcb0a54c"}} May 18 15:03:08.748463 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Invalid volume: volume c8071049-b4f8-44dd-9772-ec1ddcb0a54c is already attached to instances: 56dffbf3-4309-4b9f-992f-118a9d2b3563 May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'server_id': 'be9d1e1f-5cbc-476f-9a19-2f7e41eed262', 'body': {'volumeAttachment': {'volumeId': 'c8071049-b4f8-44dd-9772-ec1ddcb0a54c'}}} May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c8071049-b4f8-44dd-9772-ec1ddcb0a54c is already attached to instances: 56dffbf3-4309-4b9f-992f-118a9d2b3563 May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:03:08.749300 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c8071049-b4f8-44dd-9772-ec1ddcb0a54c is already attached to instances: 56dffbf3-4309-4b9f-992f-118a9d2b3563 May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:08.750772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c8071049-b4f8-44dd-9772-ec1ddcb0a54c is already attached to instances: 56dffbf3-4309-4b9f-992f-118a9d2b3563 May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 400 to user: Invalid volume: volume c8071049-b4f8-44dd-9772-ec1ddcb0a54c is already attached to instances: 56dffbf3-4309-4b9f-992f-118a9d2b3563 {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-493e3550-0f37-414c-ac0a-990faa2a1bf2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100428 May 18 15:03:08.752312 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 429/871] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:03:08 2022] POST /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 15:03:08.757210 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:08.757715 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:08.763854 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.764305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.765106 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.765547 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.797093 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:03:08.872300 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-33de0dcf-3486-4962-9374-b97f21ff6a2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 204 len: 0 microversion: 2.1 time: 0.118722 May 18 15:03:08.872916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 443/872] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:03:08 2022] DELETE /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:03:08.883685 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:08.884609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:08.891281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.891754 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:08.892525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:08.893201 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:09.024487 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:09.032311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fca1d59b-f3a6-4211-a077-39b60bbc8ee0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1681 microversion: 2.1 time: 0.154592 May 18 15:03:09.033157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 430/873] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:08 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:10.050399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:10.051238 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:10.059269 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:10.059716 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:10.060530 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:10.060996 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:10.211205 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:10.218986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-30552edf-6ecd-4b6f-a273-fdda69613c30 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1681 microversion: 2.1 time: 0.172804 May 18 15:03:10.219560 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 444/874] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:10 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:11.237250 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:11.237875 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:11.244305 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:11.244799 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:11.245558 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:11.245991 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:11.464506 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:11.472058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-27de8c44-7d0f-4f88-a53e-586a6fc2b4ac tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1681 microversion: 2.1 time: 0.238823 May 18 15:03:11.472668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 431/875] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:11 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:12.113645 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-8d5243d8-1a04-4c1d-a8d6-22f0a6ed97d8 req-dbf107f1-ed11-4c88-9da0-fdfe39af71dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9d1e1f-5cbc-476f-9a19-2f7e41eed262", "name": "network-vif-deleted", "tag": "0ff97e63-c16d-42f2-ad81-0d68433d904e"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:12.129211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-8d5243d8-1a04-4c1d-a8d6-22f0a6ed97d8 req-dbf107f1-ed11-4c88-9da0-fdfe39af71dd service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:12.129696 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-8d5243d8-1a04-4c1d-a8d6-22f0a6ed97d8 req-dbf107f1-ed11-4c88-9da0-fdfe39af71dd service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:12.143721 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-8d5243d8-1a04-4c1d-a8d6-22f0a6ed97d8 req-dbf107f1-ed11-4c88-9da0-fdfe39af71dd service nova] Creating event network-vif-deleted:0ff97e63-c16d-42f2-ad81-0d68433d904e for instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 on hv-cinder-83998 May 18 15:03:12.154647 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-8d5243d8-1a04-4c1d-a8d6-22f0a6ed97d8 req-dbf107f1-ed11-4c88-9da0-fdfe39af71dd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049267 May 18 15:03:12.155283 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 445/876] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:12.492488 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:12.493031 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:12.499631 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:12.500284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:12.501200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:12.501663 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:12.535490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:12.535943 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:12.537307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lazy-loading 'fault' on Instance uuid be9d1e1f-5cbc-476f-9a19-2f7e41eed262 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:03:12.592900 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:12.602384 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-43dde07c-4018-4485-87f9-e1bdea3b250d tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 200 len: 1331 microversion: 2.1 time: 0.114201 May 18 15:03:12.602986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 432/877] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:12 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:13.620316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:13.620972 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:13.627116 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:13.627567 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:13.628329 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:13.628799 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:13.644063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 HTTP/1.1 May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:03:13.645700 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:03:13.648063 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'be9d1e1f-5cbc-476f-9a19-2f7e41eed262'} May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:03:13.649059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:03:13.650621 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:13.651959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:03:13.651959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-06e860ef-305f-4479-8daa-bbfaeed98bb0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 404 len: 111 microversion: 2.1 time: 0.032106 May 18 15:03:13.651959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 446/878] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:13 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:03:13.656594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-11c30722-3920-44e3-a346-6e080a5538bd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '.version_select at 0x7fa8a08c81f0>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:13.674603 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-11c30722-3920-44e3-a346-6e080a5538bd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734225090" status: 202 len: 0 microversion: 2.1 time: 0.021982 May 18 15:03:13.675143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 433/879] 10.222.0.59 () {58 vars in 1217 bytes} [Wed May 18 15:03:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734225090 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:03:14.324296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:14.324839 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:14.330938 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:14.331388 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:14.332152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:14.332604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:14.410970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lazy-loading 'services' on Instance uuid 56dffbf3-4309-4b9f-992f-118a9d2b3563 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:03:14.483118 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-56bb9e5e-1c56-4771-950b-a59bd6663b83 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments/c8071049-b4f8-44dd-9772-ec1ddcb0a54c" status: 202 len: 0 microversion: 2.1 time: 0.164908 May 18 15:03:14.483861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 447/880] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:03:14 2022] DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments/c8071049-b4f8-44dd-9772-ec1ddcb0a54c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:03:14.492504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:14.493470 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:14.501335 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:14.501886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:14.502972 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:14.503610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:14.538477 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-160748ec-270a-4c6e-b576-db1ea549541b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049935 May 18 15:03:14.539030 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 434/881] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:03:14 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:15.551125 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:15.552159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:15.558557 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:15.558999 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:15.559761 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:15.560196 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:15.589379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-fdbc346b-1601-43a8-88c1-0d1283f69e9e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 May 18 15:03:15.589912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 448/882] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:03:15 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:16.601372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:16.602332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:16.608699 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:16.609152 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:16.609900 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:16.610342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:16.638809 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5bf37e7f-663c-4560-b9d1-e2b57f8d39e6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 May 18 15:03:16.639349 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 435/883] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:03:16 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:17.652327 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:17.653431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:17.660460 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:17.661016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:17.661869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:17.662381 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:17.704537 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-dff1e3a0-5d54-440a-93b1-68cf45f2c503 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057282 May 18 15:03:17.705173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 449/884] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:03:17 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:03:17.771916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:17.772407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:17.779567 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:17.780011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:17.780818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:17.781255 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:17.805979 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:03:17.879054 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-53fa9801-84e8-4111-8164-47a0921b3b65 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 204 len: 0 microversion: 2.1 time: 0.110825 May 18 15:03:17.879782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 436/885] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:03:17 2022] DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:03:17.888614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:17.889246 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:17.895340 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:17.895848 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:17.896660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:17.897123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:18.036275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:18.050809 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ff28a126-2050-434c-9aa7-2a8792153513 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1679 microversion: 2.1 time: 0.165991 May 18 15:03:18.051387 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 450/886] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:17 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:19.074084 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:19.074792 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:19.081683 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:19.082139 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:19.083037 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:19.083566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:19.217375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:19.225525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6370124a-3e9a-4245-a998-369f80de7520 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1679 microversion: 2.1 time: 0.156069 May 18 15:03:19.226669 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 437/887] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:19 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:20.243840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:20.244481 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:20.252570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:20.253071 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:20.253847 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:20.254298 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:20.339516 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:20.350813 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ff6f64e7-4ad2-4933-bd35-1747b13a72ad tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 200 len: 1613 microversion: 2.1 time: 0.111271 May 18 15:03:20.352030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 451/888] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:20 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:20.553254 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-1daedede-793a-4eb5-a72a-81ecdfc9f073 req-a3e54d25-a276-48d4-a925-f212406f67b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dffbf3-4309-4b9f-992f-118a9d2b3563", "name": "network-vif-deleted", "tag": "0ed1e1a7-57d4-4ca3-9a56-96e3e696207c"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:20.578802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1daedede-793a-4eb5-a72a-81ecdfc9f073 req-a3e54d25-a276-48d4-a925-f212406f67b6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:20.579049 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1daedede-793a-4eb5-a72a-81ecdfc9f073 req-a3e54d25-a276-48d4-a925-f212406f67b6 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:20.608404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-1daedede-793a-4eb5-a72a-81ecdfc9f073 req-a3e54d25-a276-48d4-a925-f212406f67b6 service nova] Creating event network-vif-deleted:0ed1e1a7-57d4-4ca3-9a56-96e3e696207c for instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 on hv-cinder-83998 May 18 15:03:20.616861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-1daedede-793a-4eb5-a72a-81ecdfc9f073 req-a3e54d25-a276-48d4-a925-f212406f67b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067350 May 18 15:03:20.618209 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 438/889] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:21.370940 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:21.373279 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:21.384507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:21.384927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:21.385692 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:21.386131 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:21.407558 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 HTTP/1.1 May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:03:21.409249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:03:21.410660 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '56dffbf3-4309-4b9f-992f-118a9d2b3563'} May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:03:21.411467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:03:21.413543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:03:21.415088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:03:21.415088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-95d7f560-427b-4da4-9cf1-48195a177997 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 404 len: 111 microversion: 2.1 time: 0.046063 May 18 15:03:21.415088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 452/890] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:21 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:03:21.421986 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7291a459-be92-493f-8f99-43a9fcafb965 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '.version_select at 0x7fa8a0a7dd30>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:21.445582 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7291a459-be92-493f-8f99-43a9fcafb965 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579381023" status: 202 len: 0 microversion: 2.1 time: 0.028762 May 18 15:03:21.448955 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 439/891] 10.222.0.59 () {58 vars in 1217 bytes} [Wed May 18 15:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579381023 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:03:22.199527 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-28bbd92f-46c2-4414-86c3-f739660f1ecb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: .version_select at 0x7fa8a0b4b310>, body: {"keypair": {"name": "tempest-keypair-728346851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7K3IJkXfrC06aFboVcQk9pzWRQyeaQ2nydseBkNhNNcaOd6L7M7OmX68iLtoJwrEkjjcTRI9hpZD6GssNscjkE73yOEIFQCenR2ko/KZikCdoW8h8C0B80RrNTbPipRA=="}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:22.216208 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-28bbd92f-46c2-4414-86c3-f739660f1ecb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:03:22.220988 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-28bbd92f-46c2-4414-86c3-f739660f1ecb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:03:22.246090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-28bbd92f-46c2-4414-86c3-f739660f1ecb tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050402 May 18 15:03:22.246899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 453/892] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 15:03:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:23.690760 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-137612040", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9022122f-bfa2-48d6-ae5d-8c609a059727"}], "security_groups": [{"name": "tempest-securitygroup--1689097223"}], "key_name": "tempest-keypair-728346851", "user_data": "}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:23.791133 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] validate_networks() for [('9022122f-bfa2-48d6-ae5d-8c609a059727', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:03:24.181167 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:03:24.182886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:03:24.182886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:03:24.182886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:03:24.183257 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:03:24.192111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:24.192487 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:24.193342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:24.193779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:24.211217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:03:24.215712 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:03:24.227253 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:03:24.229638 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:03:24.276028 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1b296b75-0591-4720-bcd0-556237bb28fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589958 May 18 15:03:24.276706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 440/893] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:03:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 15:03:24.287415 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-da158b8a-f4e2-4baf-832c-5497bf954af0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:24.288100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-da158b8a-f4e2-4baf-832c-5497bf954af0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:24.349993 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-da158b8a-f4e2-4baf-832c-5497bf954af0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:24.360693 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-da158b8a-f4e2-4baf-832c-5497bf954af0 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1240 microversion: 2.1 time: 0.077553 May 18 15:03:24.361891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 454/894] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:24 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:03:25.378959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:25.380342 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:25.392088 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:25.392840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:25.393820 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:25.394264 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:25.471467 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:25.479715 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-34f4c1ca-823d-450c-b7d4-25a56c978ed4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1298 microversion: 2.1 time: 0.105627 May 18 15:03:25.480286 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 441/895] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:25 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:26.497185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:26.497812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:26.500252 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:26.508811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:26.509939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:26.517100 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:26.518188 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:26.521921 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:26.799609 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:26.808179 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-68e7f71c-a333-410e-999e-c6c9ac8032e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.314819 May 18 15:03:26.809047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 455/896] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:26 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:27.201610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-293e380c-7b10-4056-ac7f-5740ac4db09d req-da394fee-9154-4bef-abd1-f431c915d6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3", "tag": "6bc6841a-03a0-4690-9f21-b311d2d31c85"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:27.206502 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:27.219588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-293e380c-7b10-4056-ac7f-5740ac4db09d req-da394fee-9154-4bef-abd1-f431c915d6ca service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:27.220027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-293e380c-7b10-4056-ac7f-5740ac4db09d req-da394fee-9154-4bef-abd1-f431c915d6ca service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:27.233146 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-293e380c-7b10-4056-ac7f-5740ac4db09d req-da394fee-9154-4bef-abd1-f431c915d6ca service nova] Creating event network-changed:6bc6841a-03a0-4690-9f21-b311d2d31c85 for instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 on hv-cinder-83998 May 18 15:03:27.238617 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-293e380c-7b10-4056-ac7f-5740ac4db09d req-da394fee-9154-4bef-abd1-f431c915d6ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052726 May 18 15:03:27.239217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 442/897] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:27.825627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:27.826250 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:27.832805 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:27.833265 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:27.834032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:27.834503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:27.962666 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:27.970175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d95dab2a-d130-446f-8520-3d108358d49e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.148454 May 18 15:03:27.970748 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 456/898] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:27 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:28.988324 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:28.989013 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:28.996860 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:28.997315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:28.998081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:28.998520 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:29.131771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:29.139459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e4c718e3-9fb4-4561-b6a8-847c19974b54 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.155966 May 18 15:03:29.140022 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 443/899] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:28 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:30.156797 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:30.157427 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:30.164802 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:30.165265 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:30.166043 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:30.166489 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:30.298576 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:30.306991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ea4dcab8-1248-460b-afc7-79a45738dd04 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.154142 May 18 15:03:30.307574 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 457/900] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:30 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:31.324511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:31.325160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:31.331606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:31.332056 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:31.332882 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:31.333326 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:31.459936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:31.467302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9c51c814-6854-475a-8a5b-1a7fafd0d72f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.146640 May 18 15:03:31.467792 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 444/901] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:31 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:32.484488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:32.485124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:32.492181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:32.492658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:32.493424 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:32.493864 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:32.624277 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:32.632344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-91f8393f-adb5-4e79-aadd-9e38924a62e9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.151745 May 18 15:03:32.632950 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 458/902] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:32 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:33.477364 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-5479589b-fa24-4680-971e-103bd50a8b22 req-14e19482-6e16-452e-8e69-b87c31966f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3", "name": "network-vif-plugged", "status": "completed", "tag": "6bc6841a-03a0-4690-9f21-b311d2d31c85"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:33.486042 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-5479589b-fa24-4680-971e-103bd50a8b22 req-14e19482-6e16-452e-8e69-b87c31966f26 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:33.486580 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-5479589b-fa24-4680-971e-103bd50a8b22 req-14e19482-6e16-452e-8e69-b87c31966f26 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:33.497790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-5479589b-fa24-4680-971e-103bd50a8b22 req-14e19482-6e16-452e-8e69-b87c31966f26 service nova] Creating event network-vif-plugged:6bc6841a-03a0-4690-9f21-b311d2d31c85 for instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 on hv-cinder-83998 May 18 15:03:33.502444 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-5479589b-fa24-4680-971e-103bd50a8b22 req-14e19482-6e16-452e-8e69-b87c31966f26 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029663 May 18 15:03:33.503043 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 445/903] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:33.648893 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:33.649591 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:33.657110 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:33.657565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:33.658330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:33.659102 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:33.827470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:33.835448 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f2bf889f-1ce2-44da-8f8c-f33b379100db tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1366 microversion: 2.1 time: 0.191035 May 18 15:03:33.836090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 459/904] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:33 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:34.848468 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:34.849275 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=6 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:34.853832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:34.854565 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:34.862343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:34.862792 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:34.863577 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:34.864014 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:34.992769 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:03:35.000143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-95c9a56f-22f0-4f06-839d-0b6cc081c080 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1557 microversion: 2.1 time: 0.152615 May 18 15:03:35.000742 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 446/905] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:03:34 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:03:35.016854 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:03:35.017350 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:03:35.019159 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:35.024847 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:35.025300 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:35.026065 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:35.026511 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:35.103220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-cdfcedf7-9662-457e-a7c7-a3f379b2b435 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090224 May 18 15:03:35.103821 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 460/906] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 15:03:35 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:03:36.035518 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-3615abb4-0767-4dfd-bfe0-c8bc451e90a4 req-28e692c1-f7a5-49a1-b13d-c43235e44c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3", "tag": "6bc6841a-03a0-4690-9f21-b311d2d31c85"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:03:36.044087 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-3615abb4-0767-4dfd-bfe0-c8bc451e90a4 req-28e692c1-f7a5-49a1-b13d-c43235e44c8d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:03:36.044555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-3615abb4-0767-4dfd-bfe0-c8bc451e90a4 req-28e692c1-f7a5-49a1-b13d-c43235e44c8d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:03:36.056320 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-3615abb4-0767-4dfd-bfe0-c8bc451e90a4 req-28e692c1-f7a5-49a1-b13d-c43235e44c8d service nova] Creating event network-changed:6bc6841a-03a0-4690-9f21-b311d2d31c85 for instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 on hv-cinder-83998 May 18 15:03:36.061797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-3615abb4-0767-4dfd-bfe0-c8bc451e90a4 req-28e692c1-f7a5-49a1-b13d-c43235e44c8d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029576 May 18 15:03:36.062766 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 447/907] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:12.059353 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=11 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:12.060137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=33 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:12.064014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:12.064505 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:12.071723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:12.072168 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:12.072953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:12.073386 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:12.096312 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2e94c1e0-7af7-4c52-bcfe-484235412c92 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/ips" status: 200 len: 151 microversion: 2.1 time: 0.038354 May 18 15:04:12.096891 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 461/908] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 15:04:12 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:13.417252 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac4a3dd0-7023-4206-8111-218f5ef56a5b"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:13.418408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:13.420664 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=11 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:13.421302 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:13.427959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:13.428407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:13.429195 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:13.429634 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:13.679205 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f3bbff24-bc03-443d-bc08-cb7dbfa2095b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266100 May 18 15:04:13.680058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 448/909] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:04:13 2022] POST /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:20.188681 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:20.189260 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:20.196240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:20.196725 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:20.197506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:20.197943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:20.224712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:04:20.299122 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-439f94b8-7e5d-4ad0-9c9b-c88cfcdf7775 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 204 len: 0 microversion: 2.1 time: 0.114005 May 18 15:04:20.300004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 462/910] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:04:20 2022] DELETE /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:04:20.309700 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:20.310392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:20.316612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:20.317055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:20.317807 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:20.318287 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:20.449876 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:20.457289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f9d9bfc9-8dd8-45e2-924d-1959b1414803 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1575 microversion: 2.1 time: 0.152469 May 18 15:04:20.457843 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 449/911] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:20 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:21.171604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac4a3dd0-7023-4206-8111-218f5ef56a5b"}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:21.172838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:21.179264 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.179968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.180771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.181202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.261866 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Invalid volume: volume ac4a3dd0-7023-4206-8111-218f5ef56a5b is already attached to instances: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: POST /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments HTTP/1.1 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 74 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:04:21.263577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {"volumeAttachment": {"volumeId": "ac4a3dd0-7023-4206-8111-218f5ef56a5b"}} May 18 15:04:21.265285 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Invalid volume: volume ac4a3dd0-7023-4206-8111-218f5ef56a5b is already attached to instances: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'server_id': '6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3', 'body': {'volumeAttachment': {'volumeId': 'ac4a3dd0-7023-4206-8111-218f5ef56a5b'}}} May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ac4a3dd0-7023-4206-8111-218f5ef56a5b is already attached to instances: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:04:21.266184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ac4a3dd0-7023-4206-8111-218f5ef56a5b is already attached to instances: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:21.267704 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ac4a3dd0-7023-4206-8111-218f5ef56a5b is already attached to instances: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 400 to user: Invalid volume: volume ac4a3dd0-7023-4206-8111-218f5ef56a5b is already attached to instances: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2b512154-8d3c-4980-a3bd-98d5098232d9 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097748 May 18 15:04:21.269344 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 463/912] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:04:21 2022] POST /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 15:04:21.327987 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:21.328484 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:21.334927 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.335383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.336146 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.336589 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.418180 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lazy-loading 'services' on Instance uuid 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:04:21.475936 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:21.476488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:21.483007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.483507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.484287 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.484806 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.495235 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2926d663-2237-4bb5-81c4-ace0b8893ed8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments/ac4a3dd0-7023-4206-8111-218f5ef56a5b" status: 202 len: 0 microversion: 2.1 time: 0.171035 May 18 15:04:21.495817 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 450/913] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:04:21 2022] DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments/ac4a3dd0-7023-4206-8111-218f5ef56a5b => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:04:21.504852 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:21.506116 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:21.512186 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.512780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.513405 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:21.513840 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:21.543585 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a0f66d5a-2ef4-4a42-b42b-bc36938b708c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 May 18 15:04:21.544135 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 451/914] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:04:21 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:04:21.626863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:21.634936 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6296454c-a938-4c6a-b718-5a211ab10e70 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1575 microversion: 2.1 time: 0.164256 May 18 15:04:21.635492 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 464/915] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:21 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:22.555806 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:22.556785 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:22.564277 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.564927 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.565722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.566168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.599078 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c8ca304e-f604-4444-8610-0cfa74520f13 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047565 May 18 15:04:22.599756 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 452/916] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:04:22 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:04:22.654334 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:22.654956 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:22.662531 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.663003 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.663977 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.664603 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.665585 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:22.666383 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:22.674338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.675096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.676610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.677206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.707307 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:04:22.784894 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2a0ce778-cb6f-4cbf-a6c2-cc6928ed73f7 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 204 len: 0 microversion: 2.1 time: 0.122796 May 18 15:04:22.786062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 453/917] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:04:22 2022] DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:04:22.795466 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:22.796168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:22.802551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.802997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.803766 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:22.804197 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:22.998454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:23.006503 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-37dca974-6e45-429c-b2a8-b552e5fd0259 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1575 microversion: 2.1 time: 0.357009 May 18 15:04:23.007114 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 465/918] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:22 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1575 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:23.072610 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:23.079965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-94295044-7b1a-4647-9d0b-a78c16b1be6f tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1682 microversion: 2.1 time: 0.289339 May 18 15:04:23.080526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 454/919] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:22 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:23.475396 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-a23ab0f8-3217-464a-8e19-a030c6fb9b70 req-21d4348e-ab11-4e24-9854-45b8c62ff2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4414a5-96ca-43e6-beba-c0892c513802", "name": "network-vif-deleted", "tag": "b4ed26f0-f48f-4f2f-8bf5-816859955580"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:23.483385 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-a23ab0f8-3217-464a-8e19-a030c6fb9b70 req-21d4348e-ab11-4e24-9854-45b8c62ff2f1 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:23.483896 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-a23ab0f8-3217-464a-8e19-a030c6fb9b70 req-21d4348e-ab11-4e24-9854-45b8c62ff2f1 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:23.495046 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-a23ab0f8-3217-464a-8e19-a030c6fb9b70 req-21d4348e-ab11-4e24-9854-45b8c62ff2f1 service nova] Creating event network-vif-deleted:b4ed26f0-f48f-4f2f-8bf5-816859955580 for instance 2e4414a5-96ca-43e6-beba-c0892c513802 on hv-cinder-83998 May 18 15:04:23.500014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-a23ab0f8-3217-464a-8e19-a030c6fb9b70 req-21d4348e-ab11-4e24-9854-45b8c62ff2f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028283 May 18 15:04:23.500634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 466/920] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:24.024216 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:24.024876 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:24.033871 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:24.034555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:24.035672 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:24.036481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:24.098794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:24.100145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:24.106450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:24.107114 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:24.108827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:24.109148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:24.111984 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:24.120555 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-623f5e63-b1cc-49ca-9eb4-12fd892fff94 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 200 len: 1507 microversion: 2.1 time: 0.101001 May 18 15:04:24.121311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 455/921] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:24 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 1507 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:24.246314 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:24.254856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-98ab94f8-58d8-4f9e-affd-0cb6aebbb53e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1682 microversion: 2.1 time: 0.160769 May 18 15:04:24.256062 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 467/922] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:24 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:25.139513 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:25.139513 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:25.147453 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.147907 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.148709 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.149149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.163990 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] HTTP exception thrown: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Request method failure captured: May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 HTTP/1.1 May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQpOrMeXdgjXnx-10TUre6G0hAr52PXfa0UxhTUinrdNcJuZTZ_YBmz4V8siA4YoFHqIO5bKA1M-JkUlQMLty5NgVelZToHQtmtqr0QaaWQ7Enp9t6D7jzaSF-HgJCMbxPHzNQwn7lbyb7B7pa5yYc6nJwpm_KHrCQNNhV2A_PgEk-Q May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:04:25.165797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-TestVolumeBootPattern-1571635726 May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-TestVolumeBootPattern-1571635726-project May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: b1a4f9ee8de446fe989b4d91ea0315e8 May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-TestVolumeBootPattern-1571635726-project May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:04:25.167200 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '2e4414a5-96ca-43e6-beba-c0892c513802'} May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:04:25.168149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:04:25.169702 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:25.171819 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Returning 404 to user: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:04:25.171819 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-3fb073bd-05b1-4b70-8826-8c530926e232 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 404 len: 111 microversion: 2.1 time: 0.032283 May 18 15:04:25.174779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 456/923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:25 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:04:25.272247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:25.272247 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:25.279424 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.279878 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.279997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1862703882", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782896207", "security_groups": [{"name": "tempest-secgroup-smoke-1025458164"}], "block_device_mapping_v2": [{"uuid": "0cc96036-4aa2-4d9f-9da6-255ca28a1756", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19da6af6-a529-4bd8-858e-9cc319b37384"}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:25.280745 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.281192 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.360373 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:25.368465 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ad29526a-6735-458b-97b7-32c41b7749b8 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 200 len: 1614 microversion: 2.1 time: 0.101001 May 18 15:04:25.369604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 468/924] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:25 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:25.447029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] validate_networks() for [('19da6af6-a529-4bd8-858e-9cc319b37384', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:04:25.518092 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-b9494d21-8b5b-4d27-8c75-85b5a390b2f9 req-1b3666f3-ffd3-42a3-b1f3-01d8f659dd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3", "name": "network-vif-deleted", "tag": "6bc6841a-03a0-4690-9f21-b311d2d31c85"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:25.532395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-b9494d21-8b5b-4d27-8c75-85b5a390b2f9 req-1b3666f3-ffd3-42a3-b1f3-01d8f659dd07 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.533154 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-b9494d21-8b5b-4d27-8c75-85b5a390b2f9 req-1b3666f3-ffd3-42a3-b1f3-01d8f659dd07 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.545161 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-b9494d21-8b5b-4d27-8c75-85b5a390b2f9 req-1b3666f3-ffd3-42a3-b1f3-01d8f659dd07 service nova] Creating event network-vif-deleted:6bc6841a-03a0-4690-9f21-b311d2d31c85 for instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 on hv-cinder-83998 May 18 15:04:25.552243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-b9494d21-8b5b-4d27-8c75-85b5a390b2f9 req-1b3666f3-ffd3-42a3-b1f3-01d8f659dd07 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039112 May 18 15:04:25.552897 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 469/925] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:25.852706 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:04:25.853214 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:04:25.853808 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:04:25.854293 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:04:25.854781 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:04:25.864196 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.864697 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.865568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:25.866079 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:25.883385 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:04:25.887392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for user b1a4f9ee8de446fe989b4d91ea0315e8 and project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:04:25.946143 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:04:25.948372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cc96036-4aa2-4d9f-9da6-255ca28a1756',volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:04:26.091375 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6931eff9-2657-49f4-a30b-93949535b7ba tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817988 May 18 15:04:26.092062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 457/926] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:04:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 15:04:26.103963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4350af05-55e3-4659-bd23-140108bd4fae tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:26.104943 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4350af05-55e3-4659-bd23-140108bd4fae tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:26.167628 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4350af05-55e3-4659-bd23-140108bd4fae tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:26.174762 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4350af05-55e3-4659-bd23-140108bd4fae tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1095 microversion: 2.1 time: 0.075505 May 18 15:04:26.175421 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 470/927] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:26 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:26.387766 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:26.388478 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:26.396403 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:26.397028 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:26.397889 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:26.398413 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:26.411484 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 HTTP/1.1 May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:04:26.413046 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:04:26.414553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3'} May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:04:26.415402 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:04:26.416902 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:04:26.418418 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:04:26.418418 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c24437d0-b5fc-423b-9605-77feab3cfa8b tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 404 len: 111 microversion: 2.1 time: 0.031101 May 18 15:04:26.418418 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 458/928] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:26 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:04:26.423751 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b2a2e9c3-6bae-41e4-a35a-497032c560c6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '.version_select at 0x7fa8a0af3280>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:26.445895 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b2a2e9c3-6bae-41e4-a35a-497032c560c6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-728346851" status: 202 len: 0 microversion: 2.1 time: 0.026152 May 18 15:04:26.446594 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 471/929] 10.222.0.59 () {58 vars in 1217 bytes} [Wed May 18 15:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-728346851 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 15:04:27.147298 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6178a8f9-5776-4c89-ac9e-951b3df20c35 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: .version_select at 0x7fa8a0ac08b0>, body: {"keypair": {"name": "tempest-keypair-2014928896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWd3yV1dS2J9kG6wMyM5ufskCF771ANo3AkZzwhek0XM7B2D0vGIVLcOW21t7/iCuBJGpzNnoVMD848gU8jgzG+3qKx6xMBnJRMDek+tj1ojQI1XTcwnUAliTdWyLconA=="}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:27.163074 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-6178a8f9-5776-4c89-ac9e-951b3df20c35 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:04:27.167265 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-6178a8f9-5776-4c89-ac9e-951b3df20c35 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'key_pairs'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:04:27.195254 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:27.195974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:27.201294 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6178a8f9-5776-4c89-ac9e-951b3df20c35 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059668 May 18 15:04:27.201970 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 459/930] 10.222.0.59 () {60 vars in 1158 bytes} [Wed May 18 15:04:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:27.202478 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:27.203130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:27.204032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:27.204475 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:27.277113 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:27.286849 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-baedd653-3ca0-4985-98b7-43a7b9498091 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1211 microversion: 2.1 time: 0.097251 May 18 15:04:27.288386 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 472/931] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:27 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:28.304573 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:28.305442 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:28.312482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:28.313221 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:28.314027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:28.314459 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:28.574489 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:28.587482 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-47f5307b-4b37-4a76-9901-ecb5781bf040 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.285515 May 18 15:04:28.588781 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 460/932] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:28 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:28.662136 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223428565", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9022122f-bfa2-48d6-ae5d-8c609a059727"}], "security_groups": [{"name": "tempest-securitygroup--977706017"}], "key_name": "tempest-keypair-2014928896", "user_data": "}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:28.779830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-393873b7-f59b-4d75-ace1-0e4413d24154 req-099ffbf2-75a3-41ac-8b30-90598bea086c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19720ba-f060-4b0c-9f92-bfe6dd401d8c", "tag": "d606525d-ae8c-4f8f-bf39-230c02f71e29"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:28.794340 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-393873b7-f59b-4d75-ace1-0e4413d24154 req-099ffbf2-75a3-41ac-8b30-90598bea086c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:28.794784 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-393873b7-f59b-4d75-ace1-0e4413d24154 req-099ffbf2-75a3-41ac-8b30-90598bea086c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:28.819811 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-393873b7-f59b-4d75-ace1-0e4413d24154 req-099ffbf2-75a3-41ac-8b30-90598bea086c service nova] Creating event network-changed:d606525d-ae8c-4f8f-bf39-230c02f71e29 for instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c on hv-cinder-83998 May 18 15:04:28.827114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-393873b7-f59b-4d75-ace1-0e4413d24154 req-099ffbf2-75a3-41ac-8b30-90598bea086c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051676 May 18 15:04:28.827842 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 461/933] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:28.851781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] validate_networks() for [('9022122f-bfa2-48d6-ae5d-8c609a059727', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:04:29.605504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:29.606332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:29.612834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:29.613313 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:29.614081 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:29.614633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:29.814043 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:04:29.814474 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:04:29.814927 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:04:29.815329 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:04:29.815739 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:04:29.825637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:29.826079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:29.827102 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:29.827725 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:29.841377 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:29.845851 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:04:29.849126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0d99b839-7e21-4184-8454-aecce4aa2114 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.248883 May 18 15:04:29.849768 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Getting quotas for user a21b520b8aaa45538f59ceeab4ec9d17 and project 0d032e462665466d83ab51e9c116d1e0. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:04:29.849940 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 462/934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:29 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:29.860663 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:04:29.862916 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:04:29.909387 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ffcaa12d-e314-4872-adb4-0a0baf6cfaa3 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.251887 May 18 15:04:29.910052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 473/935] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:04:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 15:04:29.920504 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1e1e13e5-c2bf-4500-8692-d701c6fd979e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:29.921164 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1e1e13e5-c2bf-4500-8692-d701c6fd979e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:29.973559 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1e1e13e5-c2bf-4500-8692-d701c6fd979e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:29.980481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1e1e13e5-c2bf-4500-8692-d701c6fd979e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1241 microversion: 2.1 time: 0.063941 May 18 15:04:29.981153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 463/936] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:29 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:30.866513 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:30.867110 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:30.873248 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:30.873701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:30.874567 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:30.875000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:30.998210 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:30.999341 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:31.007711 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:31.008160 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:31.008964 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:31.009394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:31.102627 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:31.109958 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-740a7eef-6f36-4936-a32d-35a6a5b1efcd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1299 microversion: 2.1 time: 0.115745 May 18 15:04:31.110519 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 464/937] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:30 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:31.116659 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:31.124794 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8be1549a-0b9f-4a11-8273-0413528cbc4f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.262646 May 18 15:04:31.125461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 474/938] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:30 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:32.128389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:32.129098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:32.139777 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:32.140233 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:32.141055 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:32.141497 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:32.142475 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:32.145851 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:32.155214 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:32.155992 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:32.157137 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:32.158722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:32.163511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:32.416978 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:32.424665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6b0d9c7e-51af-4d9d-91b3-14a2af9b9434 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1366 microversion: 2.1 time: 0.300878 May 18 15:04:32.425347 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 465/939] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:32 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:32.430124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:32.437775 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-8a93b293-6878-4fe2-b411-0d9a3ea37f34 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.299466 May 18 15:04:32.438463 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 475/940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:32 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:32.538957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-c0f6fc3b-d64a-44fc-89b7-2f795f0d2996 req-d1315fca-f66f-49ba-a135-b3a02e569ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2", "tag": "4917e72d-9860-42a1-987f-9d06e66d46d1"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:32.550526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-c0f6fc3b-d64a-44fc-89b7-2f795f0d2996 req-d1315fca-f66f-49ba-a135-b3a02e569ccf service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:32.551029 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-c0f6fc3b-d64a-44fc-89b7-2f795f0d2996 req-d1315fca-f66f-49ba-a135-b3a02e569ccf service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:32.566128 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-c0f6fc3b-d64a-44fc-89b7-2f795f0d2996 req-d1315fca-f66f-49ba-a135-b3a02e569ccf service nova] Creating event network-changed:4917e72d-9860-42a1-987f-9d06e66d46d1 for instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 on hv-cinder-83998 May 18 15:04:32.573727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-c0f6fc3b-d64a-44fc-89b7-2f795f0d2996 req-d1315fca-f66f-49ba-a135-b3a02e569ccf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040292 May 18 15:04:32.574867 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 466/941] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:33.442451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:33.443083 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:33.449552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:33.450001 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:33.450771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:33.451209 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:33.455133 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:33.455829 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:33.463044 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:33.463485 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:33.464301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:33.464705 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:33.651715 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:33.656256 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:33.659648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1c50824c-2440-4d8d-bb0d-8baa1198e4fd tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1366 microversion: 2.1 time: 0.221634 May 18 15:04:33.660222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 476/942] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:33 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:33.666319 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-fdf36a62-57fb-43a6-a698-0944dd453568 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.215482 May 18 15:04:33.666991 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 467/943] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:33 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:34.677945 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:34.678564 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:34.682577 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:34.683193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:34.685453 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:34.685899 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:34.686822 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:34.687253 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:34.689512 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:34.689965 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:34.690732 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:34.691800 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:34.887869 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:34.891361 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:34.896425 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-e98ccc90-c7ea-4880-bc7d-2a50225b15a2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1366 microversion: 2.1 time: 0.223535 May 18 15:04:34.897080 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 477/944] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:34 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:34.899542 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d2095a08-0577-46f6-9d5f-1fcfa90290d9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.221102 May 18 15:04:34.900088 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 468/945] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:34 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:35.891509 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-c54f3ecc-c731-4dbb-81f5-368efb200128 req-9b201cd8-96ba-4d25-a438-f027a146bff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2", "name": "network-vif-plugged", "status": "completed", "tag": "4917e72d-9860-42a1-987f-9d06e66d46d1"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:35.900599 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-c54f3ecc-c731-4dbb-81f5-368efb200128 req-9b201cd8-96ba-4d25-a438-f027a146bff9 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:35.901048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-c54f3ecc-c731-4dbb-81f5-368efb200128 req-9b201cd8-96ba-4d25-a438-f027a146bff9 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:35.915027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:35.915586 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-c54f3ecc-c731-4dbb-81f5-368efb200128 req-9b201cd8-96ba-4d25-a438-f027a146bff9 service nova] Creating event network-vif-plugged:4917e72d-9860-42a1-987f-9d06e66d46d1 for instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 on hv-cinder-83998 May 18 15:04:35.915720 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:35.920830 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-c54f3ecc-c731-4dbb-81f5-368efb200128 req-9b201cd8-96ba-4d25-a438-f027a146bff9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 May 18 15:04:35.921467 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 478/946] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:35.924538 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:35.926632 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:35.927083 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:35.927853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:35.928566 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:35.928928 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:35.929376 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:35.936980 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:35.937434 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:35.938522 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:35.938971 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:36.196352 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:36.201847 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:36.215574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-469d3a40-f380-4849-8c50-0d92341b9c2c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1366 microversion: 2.1 time: 0.305792 May 18 15:04:36.216168 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 469/947] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:35 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:36.218581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-294604ea-db7c-47bb-b3c5-5977390f093a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.295679 May 18 15:04:36.219156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 479/948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:35 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:37.232269 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:37.232921 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:37.235221 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:37.235855 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:37.240134 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:37.240592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:37.241374 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:37.241896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:37.255052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:37.255863 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:37.258152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:37.258617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:37.446241 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:37.450533 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:37.454112 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:37.454262 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1f5688a5-919d-4d43-8a08-94fbb24540da tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1366 microversion: 2.1 time: 0.225907 May 18 15:04:37.455834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 470/949] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:37 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:37.460644 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-828bd041-7c4f-442b-a0f8-b0bd134c915f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.229147 May 18 15:04:37.461220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 480/950] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:37 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:37.948336 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-93b90ab8-ae48-42ad-b9de-3f6caefef981 req-8f7e1115-91b6-409e-8a37-d9001cc8f10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19720ba-f060-4b0c-9f92-bfe6dd401d8c", "name": "network-vif-plugged", "status": "completed", "tag": "d606525d-ae8c-4f8f-bf39-230c02f71e29"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:37.956268 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-93b90ab8-ae48-42ad-b9de-3f6caefef981 req-8f7e1115-91b6-409e-8a37-d9001cc8f10d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:37.957258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-93b90ab8-ae48-42ad-b9de-3f6caefef981 req-8f7e1115-91b6-409e-8a37-d9001cc8f10d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:37.967869 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-93b90ab8-ae48-42ad-b9de-3f6caefef981 req-8f7e1115-91b6-409e-8a37-d9001cc8f10d service nova] Creating event network-vif-plugged:d606525d-ae8c-4f8f-bf39-230c02f71e29 for instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c on hv-cinder-83998 May 18 15:04:37.973353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-93b90ab8-ae48-42ad-b9de-3f6caefef981 req-8f7e1115-91b6-409e-8a37-d9001cc8f10d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027956 May 18 15:04:37.973916 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 471/951] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:38.471664 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:38.472273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:38.478305 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:38.479004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:38.480702 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:38.481156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:38.481930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:38.482370 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:38.485174 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:38.485609 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:38.486362 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:38.486792 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:38.676000 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:38.684200 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9b063f22-1a5a-40af-bb3a-0fea82e8ce76 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1556 microversion: 2.1 time: 0.216785 May 18 15:04:38.684807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 481/952] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:38 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1556 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:38.690571 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:38.698788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ce414172-96d0-45be-bc30-e048bf607551 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1267 microversion: 2.1 time: 0.225034 May 18 15:04:38.699353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 472/953] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:38 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:04:38.701074 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:38.701577 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:38.707562 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:38.708019 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:38.708829 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:38.709275 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:38.788289 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-6c0f3f87-a646-4b76-8647-47351da7cdc4 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091112 May 18 15:04:38.789231 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 482/954] 10.222.0.59 () {58 vars in 1274 bytes} [Wed May 18 15:04:38 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:04:39.714744 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:39.715353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:39.721755 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:39.722204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:39.722969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:39.723387 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:39.949119 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:39.956490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b36ac19a-96c3-4686-9ea3-789c3b006a46 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1453 microversion: 2.1 time: 0.245762 May 18 15:04:39.957082 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 473/955] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:39 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1453 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:39.969661 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:39.970413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=8 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:39.974539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:04:39.975149 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:04:39.981974 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:39.982422 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:39.983184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:39.983650 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:40.154691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-3fc13b46-28cd-48e6-8fc6-2e13cca4a691 req-36dd1617-6470-436f-8784-bf549a3a1fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2", "tag": "4917e72d-9860-42a1-987f-9d06e66d46d1"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:40.158608 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=12 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:40.166765 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-3fc13b46-28cd-48e6-8fc6-2e13cca4a691 req-36dd1617-6470-436f-8784-bf549a3a1fa2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:40.167311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-3fc13b46-28cd-48e6-8fc6-2e13cca4a691 req-36dd1617-6470-436f-8784-bf549a3a1fa2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:40.180014 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-3fc13b46-28cd-48e6-8fc6-2e13cca4a691 req-36dd1617-6470-436f-8784-bf549a3a1fa2 service nova] Creating event network-changed:4917e72d-9860-42a1-987f-9d06e66d46d1 for instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 on hv-cinder-83998 May 18 15:04:40.185413 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-3fc13b46-28cd-48e6-8fc6-2e13cca4a691 req-36dd1617-6470-436f-8784-bf549a3a1fa2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034556 May 18 15:04:40.186356 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 474/956] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:04:40.199816 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:04:40.209278 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-44857a19-2e74-4597-8bfe-7a8306f636a7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1453 microversion: 2.1 time: 0.240689 May 18 15:04:40.218260 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 483/957] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:04:39 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:04:41.879319 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-14143a45-0e7a-4462-9e82-3744d7b0213a req-da91c2bb-6632-47ab-8c1c-e35630d552ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19720ba-f060-4b0c-9f92-bfe6dd401d8c", "tag": "d606525d-ae8c-4f8f-bf39-230c02f71e29"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:04:41.888062 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-14143a45-0e7a-4462-9e82-3744d7b0213a req-da91c2bb-6632-47ab-8c1c-e35630d552ac service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:04:41.888783 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-14143a45-0e7a-4462-9e82-3744d7b0213a req-da91c2bb-6632-47ab-8c1c-e35630d552ac service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:04:41.900353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-14143a45-0e7a-4462-9e82-3744d7b0213a req-da91c2bb-6632-47ab-8c1c-e35630d552ac service nova] Creating event network-changed:d606525d-ae8c-4f8f-bf39-230c02f71e29 for instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c on hv-cinder-83998 May 18 15:04:41.905295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-14143a45-0e7a-4462-9e82-3744d7b0213a req-da91c2bb-6632-47ab-8c1c-e35630d552ac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030791 May 18 15:04:41.905886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 475/958] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:05:15.041669 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:15.042331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:15.044263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:15.045183 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=16 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:15.056020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:15.056474 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:15.057658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:15.058474 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:15.091998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2c649ba4-5b57-412c-b1c3-095b0591774a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/ips" status: 200 len: 150 microversion: 2.1 time: 0.054674 May 18 15:05:15.092600 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 484/959] 10.222.0.59 () {58 vars in 1247 bytes} [Wed May 18 15:05:15 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:05:16.409927 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:16.410659 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=46 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:16.415260 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd8c302e-9040-4900-9080-3e6492d66365"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:05:16.416408 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:16.423825 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:16.424282 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:16.425076 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:16.425516 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:16.686207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-5f7d96ee-31fc-41cc-8320-3f03960a419a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "POST /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277962 May 18 15:05:16.686830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 476/960] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:05:16 2022] POST /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:05:24.292736 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:24.293259 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:24.299918 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:24.300376 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:24.301184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:24.301629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:24.381360 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lazy-loading 'services' on Instance uuid d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:05:24.451156 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-eb9c4471-963e-48c4-97d1-c3810e7d80cc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments/fd8c302e-9040-4900-9080-3e6492d66365" status: 202 len: 0 microversion: 2.1 time: 0.162195 May 18 15:05:24.451771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 485/961] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:05:24 2022] DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments/fd8c302e-9040-4900-9080-3e6492d66365 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:05:24.461675 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:24.462818 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:24.469245 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:24.469782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:24.471266 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:24.472524 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:24.501391 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-15c16a17-32f7-4143-a691-b42d0038a29c tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 May 18 15:05:24.502434 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 477/962] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:05:24 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:05:25.514784 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:25.515883 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:25.522153 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:25.522604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:25.523367 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:25.523807 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:25.552377 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a6e21dae-8d6a-4d8e-9644-56a60e5706ab tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042651 May 18 15:05:25.552966 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 486/963] 10.222.0.59 () {58 vars in 1301 bytes} [Wed May 18 15:05:25 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 15:05:25.609427 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:25.609934 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:25.617166 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:25.617624 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:25.618427 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:25.618895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:25.644602 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:05:25.718563 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c9a700c7-fb00-448e-a2ef-e7ab6cd1585e tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 204 len: 0 microversion: 2.1 time: 0.112713 May 18 15:05:25.719138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 478/964] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:05:25 2022] DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:05:25.728006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:25.728656 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:25.734476 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:25.734923 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:25.735685 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:25.736126 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:25.870307 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:05:25.877789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d4dbfc2d-f2fa-4d79-a419-99063d39c570 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1681 microversion: 2.1 time: 0.153758 May 18 15:05:25.878351 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 487/965] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:25 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:05:26.895047 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:26.895691 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:26.902229 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:26.902674 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:26.903427 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:26.903859 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:27.033726 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:05:27.041365 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6a3f5035-9cc8-432e-a316-1c4ae33b4666 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1681 microversion: 2.1 time: 0.150608 May 18 15:05:27.041932 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 479/966] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:26 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:05:28.059181 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:28.059716 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:28.066749 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:28.067202 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:28.067968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:28.068408 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:28.145388 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b520b8aaa45538f59ceeab4ec9d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d032e462665466d83ab51e9c116d1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:05:28.152997 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a6a90190-8532-4ac8-b7c9-d2f5cf927786 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 200 len: 1614 microversion: 2.1 time: 0.098040 May 18 15:05:28.153590 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 488/967] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:28 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:05:28.265332 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-8f2b4c71-1353-491b-b101-e6ee23ea11e1 req-4e0dbdd8-b8e2-434a-945b-96122a5dba91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2", "name": "network-vif-deleted", "tag": "4917e72d-9860-42a1-987f-9d06e66d46d1"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:05:28.280457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-8f2b4c71-1353-491b-b101-e6ee23ea11e1 req-4e0dbdd8-b8e2-434a-945b-96122a5dba91 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:28.281095 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-8f2b4c71-1353-491b-b101-e6ee23ea11e1 req-4e0dbdd8-b8e2-434a-945b-96122a5dba91 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:28.301541 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-8f2b4c71-1353-491b-b101-e6ee23ea11e1 req-4e0dbdd8-b8e2-434a-945b-96122a5dba91 service nova] Creating event network-vif-deleted:4917e72d-9860-42a1-987f-9d06e66d46d1 for instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 on hv-cinder-83998 May 18 15:05:28.306979 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-8f2b4c71-1353-491b-b101-e6ee23ea11e1 req-4e0dbdd8-b8e2-434a-945b-96122a5dba91 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045536 May 18 15:05:28.308230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 480/968] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:05:29.170427 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:29.170990 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:29.179297 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:29.180011 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:29.180828 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:29.181274 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:29.196390 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 HTTP/1.1 May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:05:29.198224 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:29.199746 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'd1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2'} May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:29.200638 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:29.202026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:29.203266 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:29.204174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ea97e0e8-3d6a-4f57-95eb-4e9ecc335093 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 404 len: 111 microversion: 2.1 time: 0.037649 May 18 15:05:29.205408 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 489/969] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:29 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:05:29.214974 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-de3953dc-6391-45d7-bcb5-7b2cb82be50a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '.version_select at 0x7fa8a0b41310>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:29.232728 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-de3953dc-6391-45d7-bcb5-7b2cb82be50a tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014928896" status: 202 len: 0 microversion: 2.1 time: 0.021926 May 18 15:05:29.233327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 481/970] 10.222.0.59 () {58 vars in 1220 bytes} [Wed May 18 15:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014928896 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:05:30.975339 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:30.976862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:30.983963 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:30.984423 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:30.985230 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:30.985678 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:30.999163 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 HTTP/1.1 May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:05:31.000939 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.002539 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'd1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2'} May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:31.003451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.005054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:31.006648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:31.006648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-123eb5e3-837e-43d7-8714-a00598a67bfc tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 404 len: 111 microversion: 2.1 time: 0.030885 May 18 15:05:31.006648 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 490/971] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:05:30 2022] DELETE /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:05:31.011096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:31.011834 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:31.018667 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:31.019117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:31.019882 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:31.020323 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:31.034244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 HTTP/1.1 May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:05:31.035914 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.037490 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'd1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2'} May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:31.038575 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. May 18 15:05:31.040111 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:31.041592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:31.041592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b81ee09d-730f-44d4-94c9-5335976d3261 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2" status: 404 len: 111 microversion: 2.1 time: 0.030533 May 18 15:05:31.041592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 482/972] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:31 2022] GET /compute/v2.1/servers/d1abe2e5-a4cc-47d2-a20c-3d5ca85a6fc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 15:05:32.170271 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:32.170786 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:32.178152 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.178599 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.179354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.180052 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.193162 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 HTTP/1.1 May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:05:32.194695 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.196316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3'} May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:32.197284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.198764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.200507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:32.200507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1032d99c-8e1a-4bb4-9b5f-7f8b9d77c195 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 404 len: 111 microversion: 2.1 time: 0.029684 May 18 15:05:32.200507 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 491/973] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:05:32 2022] DELETE /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:05:32.204315 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:32.204956 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:32.211642 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.212094 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.212941 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.213394 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.228117 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 HTTP/1.1 May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:05:32.229671 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.231297 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3'} May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:32.233110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. May 18 15:05:32.234618 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.236554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance 6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:32.236554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-86ab2560-dd93-45cf-9c96-cf2bc968bf48 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3" status: 404 len: 111 microversion: 2.1 time: 0.030511 May 18 15:05:32.236554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 483/974] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:32 2022] GET /compute/v2.1/servers/6f5d990d-62fe-4ba3-8f3e-3ec9da6e1ae3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 15:05:32.240450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:32.240977 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:32.247123 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.247570 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.248349 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.248812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.262919 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 HTTP/1.1 May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:05:32.264473 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.266986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'be9d1e1f-5cbc-476f-9a19-2f7e41eed262'} May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:32.268391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.270781 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:32.273145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:32.273145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4cc39064-1f78-4b60-a47e-a95a652ec977 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 404 len: 111 microversion: 2.1 time: 0.029979 May 18 15:05:32.273145 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 492/975] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:05:32 2022] DELETE /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:05:32.274773 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:32.275381 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: be9d1e1f-5cbc-476f-9a19-2f7e41eed262] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:32.282006 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.282959 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.283713 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:32.284142 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:32.299166 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 HTTP/1.1 May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:05:32.300704 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.302299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'be9d1e1f-5cbc-476f-9a19-2f7e41eed262'} May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:32.303217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. May 18 15:05:32.304861 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:32.305989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance be9d1e1f-5cbc-476f-9a19-2f7e41eed262 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:32.305989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c4bfc22e-2b7f-438a-ab7f-4dfde5c8d9f6 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262" status: 404 len: 111 microversion: 2.1 time: 0.031228 May 18 15:05:32.305989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 484/976] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:32 2022] GET /compute/v2.1/servers/be9d1e1f-5cbc-476f-9a19-2f7e41eed262 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 15:05:33.444450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:33.444984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:33.451428 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:33.451874 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:33.452651 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:33.453090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:33.466705 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 HTTP/1.1 May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:05:33.468219 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.469861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '56dffbf3-4309-4b9f-992f-118a9d2b3563'} May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:33.471401 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.472912 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:05:33.474450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:33.474450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d89e37ba-7517-4f7f-a3b8-ee9aafaf7ca2 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 404 len: 111 microversion: 2.1 time: 0.029633 May 18 15:05:33.474450 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 493/977] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:05:33 2022] DELETE /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:05:33.478338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:05:33.478947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] [instance: 56dffbf3-4309-4b9f-992f-118a9d2b3563] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:05:33.485321 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:33.485787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:33.486539 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:05:33.486968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:05:33.499802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] HTTP exception thrown: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Request method failure captured: May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 HTTP/1.1 May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQopDL3Q3fLLIEG3kRyJn8zo5pk-2sZqAMJWW47-O9gJ-45wjId8Efp4U8oPTPRUY7hhL0meKe0Kt5Afmg9cPQ9IzPDDESRLpMYoEK1GUzYmdatQ0Bv_-Whdpczqdq6_Gn0t7aEZbhJdz85FDycFCizbDrQMfc5rJpSO21XYsfoXdTw May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:05:33.501832 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d032e462665466d83ab51e9c116d1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 0d032e462665466d83ab51e9c116d1e0 May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-868107877 May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: a21b520b8aaa45538f59ceeab4ec9d17 May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-AttachVolumeNegativeTest-868107877-project May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.503410 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '56dffbf3-4309-4b9f-992f-118a9d2b3563'} May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:05:33.504258 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. May 18 15:05:33.505748 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:05:33.507066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] Returning 404 to user: Instance 56dffbf3-4309-4b9f-992f-118a9d2b3563 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:05:33.507066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-26d0b69f-dc68-42a3-a044-349f03cc2654 tempest-AttachVolumeNegativeTest-868107877 tempest-AttachVolumeNegativeTest-868107877-project] 10.222.0.59 "GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563" status: 404 len: 111 microversion: 2.1 time: 0.028592 May 18 15:05:33.507066 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 485/978] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:05:33 2022] GET /compute/v2.1/servers/56dffbf3-4309-4b9f-992f-118a9d2b3563 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:06:07.595946 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1348716326", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "networks": [{"uuid": "af259da3-6954-4c7e-8bc3-5252f5783ea7"}]}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:07.602898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=20 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:07.603542 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:07.814706 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] validate_networks() for [('af259da3-6954-4c7e-8bc3-5252f5783ea7', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:06:08.216096 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:06:08.216520 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:06:08.217032 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:06:08.217445 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:06:08.217862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:06:08.230789 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:08.231239 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:08.232047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:08.232487 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:08.249174 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Getting quotas for project 00895e40e4484304937344779ff6f048. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:06:08.253606 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Getting quotas for user b1fcf616a6f543a9898c3ed755131d03 and project 00895e40e4484304937344779ff6f048. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:06:08.268500 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:06:08.270811 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:06:08.322755 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7ceaba92-4fcb-44e3-8e6f-7a141da882e2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731153 May 18 15:06:08.323629 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 494/979] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 15:06:08.333788 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1673b200-1987-4641-ac39-3b23ef73dcab tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:08.334409 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1673b200-1987-4641-ac39-3b23ef73dcab tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:08.336574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:08.337242 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:08.460481 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1673b200-1987-4641-ac39-3b23ef73dcab tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:08.467406 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1673b200-1987-4641-ac39-3b23ef73dcab tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1219 microversion: 2.1 time: 0.137619 May 18 15:06:08.468059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 486/980] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:08 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:09.486391 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:09.487581 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:09.494495 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:09.495030 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:09.495861 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:09.496308 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:09.578819 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:09.587051 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5fa58743-2233-4115-8f17-9c1bc642ea41 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1289 microversion: 2.1 time: 0.105308 May 18 15:06:09.587624 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 495/981] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:09 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:10.604495 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:10.605185 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:10.613422 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:10.613910 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:10.614668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:10.615100 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:10.746370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:10.753827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1d379e88-c8cb-4a17-9602-65b3538c68af tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.153239 May 18 15:06:10.754390 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 487/982] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:10 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:11.771684 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:11.772327 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:11.778925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:11.779379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:11.780148 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:11.780609 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:11.912526 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:11.919901 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-34b0911e-4937-494d-a9b2-a9dea6a2a19a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.152149 May 18 15:06:11.920472 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 496/983] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:11 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:12.938184 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:12.939414 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:12.946141 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:12.946783 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:12.947868 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:12.948365 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:12.955949 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-7ff9cbde-ecec-450d-b253-2d4f5a04b654 req-d30ce690-48f7-40cf-90d5-538b833f266b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134d1a43-f6e9-481b-891c-d9af293d39b3", "tag": "50595964-603e-4437-8916-b082496f51bb"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:12.968296 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-7ff9cbde-ecec-450d-b253-2d4f5a04b654 req-d30ce690-48f7-40cf-90d5-538b833f266b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:12.968961 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-7ff9cbde-ecec-450d-b253-2d4f5a04b654 req-d30ce690-48f7-40cf-90d5-538b833f266b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:12.980399 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-7ff9cbde-ecec-450d-b253-2d4f5a04b654 req-d30ce690-48f7-40cf-90d5-538b833f266b service nova] Creating event network-changed:50595964-603e-4437-8916-b082496f51bb for instance 134d1a43-f6e9-481b-891c-d9af293d39b3 on hv-cinder-83998 May 18 15:06:12.986387 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-7ff9cbde-ecec-450d-b253-2d4f5a04b654 req-d30ce690-48f7-40cf-90d5-538b833f266b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114313 May 18 15:06:12.986995 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 488/984] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:06:13.170143 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:13.178415 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1b82e90f-203a-4d2c-9ee6-15176ba3a39c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.244460 May 18 15:06:13.178990 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 497/985] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:12 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:14.196727 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:14.197426 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:14.204131 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:14.204574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:14.205349 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:14.205780 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:14.652344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:14.660311 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-0dd4589f-d72e-4e45-b7b0-3271ad7207df tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.467930 May 18 15:06:14.660901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 489/986] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:14 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:15.677422 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:15.677953 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:15.685398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:15.685853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:15.686637 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:15.687594 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:15.819893 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:15.827225 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ec10ee36-e594-4a52-97a5-00eb9791ba63 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.153785 May 18 15:06:15.828413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 498/987] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:15 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:16.173594 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-759359209", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782896207", "security_groups": [{"name": "tempest-secgroup-smoke-1025458164"}], "block_device_mapping_v2": [{"uuid": "92813b6b-4871-44c4-a290-7cccf86b638e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19da6af6-a529-4bd8-858e-9cc319b37384"}]}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:16.286351 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.network.neutron [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] validate_networks() for [('19da6af6-a529-4bd8-858e-9cc319b37384', None, None, None, None, None)] {{(pid=123865) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:06:16.728640 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Flavor limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:06:16.729065 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Image limits 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:06:16.729540 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Flavor pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:06:16.729947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Image pref 0:0:0 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:06:16.730357 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.virt.hardware [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:06:16.740013 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:16.740391 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:16.741229 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:16.741665 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:16.759421 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:06:16.766001 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.quota [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Getting quotas for user b1a4f9ee8de446fe989b4d91ea0315e8 and project d2f3dc5d9c6648c79267f71b5a86f249. Resources: {'instances', 'cores', 'ram'} {{(pid=123865) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:06:16.827474 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Going to run 1 instances... {{(pid=123865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:06:16.829645 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92813b6b-4871-44c4-a290-7cccf86b638e',volume_size=None,volume_type=None)] {{(pid=123865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:06:16.844571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:16.845269 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:16.851862 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:16.852316 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:16.853130 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:16.853576 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:16.959888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-87478dd7-057c-4e5e-a5b0-ea2bdf2a3c36 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790707 May 18 15:06:16.960729 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 490/988] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:06:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 15:06:16.971077 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6250db4a-e651-4c3a-b030-1ee521ddd2ec tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:16.971693 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6250db4a-e651-4c3a-b030-1ee521ddd2ec tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:17.001007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:17.018900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-14bc78c3-a8a5-4eb8-968b-cad3a0d5610c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.178191 May 18 15:06:17.019536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 499/989] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:16 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:17.030492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6250db4a-e651-4c3a-b030-1ee521ddd2ec tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:17.037333 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6250db4a-e651-4c3a-b030-1ee521ddd2ec tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1094 microversion: 2.1 time: 0.070595 May 18 15:06:17.038103 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 491/990] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:16 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:18.036608 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:18.037400 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:18.043867 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:18.044390 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:18.045293 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:18.045834 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:18.056978 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:18.058194 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:18.069285 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:18.069740 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:18.070521 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:18.071149 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:18.213161 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:18.220854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-a3182e62-9159-49ca-aade-762e5c74f0a5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1210 microversion: 2.1 time: 0.170488 May 18 15:06:18.221427 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 492/991] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:18 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:18.240249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:18.259743 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:18.288439 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:18.314113 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-d2ef7e0e-2cd3-4dcb-8ca8-57e74b89490d tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.278285 May 18 15:06:18.324138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 500/992] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:18 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:18.377208 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-fadd9c03-8689-4953-9f1a-b105ae4cab12 req-b07da664-8c70-4d4e-97e6-a8cd6b14177c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134d1a43-f6e9-481b-891c-d9af293d39b3", "name": "network-vif-plugged", "status": "completed", "tag": "50595964-603e-4437-8916-b082496f51bb"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:18.386113 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-fadd9c03-8689-4953-9f1a-b105ae4cab12 req-b07da664-8c70-4d4e-97e6-a8cd6b14177c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:18.386559 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-fadd9c03-8689-4953-9f1a-b105ae4cab12 req-b07da664-8c70-4d4e-97e6-a8cd6b14177c service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:18.398183 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-fadd9c03-8689-4953-9f1a-b105ae4cab12 req-b07da664-8c70-4d4e-97e6-a8cd6b14177c service nova] Creating event network-vif-plugged:50595964-603e-4437-8916-b082496f51bb for instance 134d1a43-f6e9-481b-891c-d9af293d39b3 on hv-cinder-83998 May 18 15:06:18.403033 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-fadd9c03-8689-4953-9f1a-b105ae4cab12 req-b07da664-8c70-4d4e-97e6-a8cd6b14177c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115623 May 18 15:06:18.403670 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 493/993] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:06:19.239536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:19.240077 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:19.247232 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:19.247709 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:19.248543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:19.249057 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:19.341917 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:19.342648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:19.363301 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:19.364687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:19.365661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:19.366102 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:19.486614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:19.494026 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-98fa9097-bde0-412d-961b-00376d2bb72a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.259019 May 18 15:06:19.494614 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 501/994] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:19 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:19.604359 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:19.619842 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-36d909ac-67e6-43da-b669-02ae229c7cd0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1319 microversion: 2.1 time: 0.291940 May 18 15:06:19.629854 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 494/995] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:19 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:19.839255 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-2983e145-398e-4f57-a710-f140e64b9423 req-6bec68c3-a8bf-403c-b33e-c5005d44bd4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366e5a82-fcc6-43b2-bee6-18a102900b29", "tag": "9a2aa193-61d5-49e1-874d-e6b962c370c9"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:19.848379 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2983e145-398e-4f57-a710-f140e64b9423 req-6bec68c3-a8bf-403c-b33e-c5005d44bd4d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:19.849029 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2983e145-398e-4f57-a710-f140e64b9423 req-6bec68c3-a8bf-403c-b33e-c5005d44bd4d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:19.862075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-2983e145-398e-4f57-a710-f140e64b9423 req-6bec68c3-a8bf-403c-b33e-c5005d44bd4d service nova] Creating event network-changed:9a2aa193-61d5-49e1-874d-e6b962c370c9 for instance 366e5a82-fcc6-43b2-bee6-18a102900b29 on hv-cinder-83998 May 18 15:06:19.867313 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-2983e145-398e-4f57-a710-f140e64b9423 req-6bec68c3-a8bf-403c-b33e-c5005d44bd4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031682 May 18 15:06:19.867930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 502/996] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:06:20.511668 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:20.512289 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:20.519429 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:20.520115 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:20.520917 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:20.521350 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:20.638428 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:20.639138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:20.645428 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:20.645973 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:20.646804 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:20.647240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:20.776263 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:20.784137 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-49a72db2-025f-4af4-a759-c0453719083f tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.277346 May 18 15:06:20.784723 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 495/997] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:20 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:20.886354 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:20.895313 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ba281bef-9f06-4fbc-9cfa-8f3bf160fb84 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1508 microversion: 2.1 time: 0.261406 May 18 15:06:20.895920 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 503/998] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:20 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:21.801134 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:21.801710 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:21.808416 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:21.808895 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:21.809666 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:21.810110 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:21.951256 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:21.958942 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-c72053a5-a429-443b-9d39-946549439260 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.161834 May 18 15:06:21.959520 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 496/999] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:21 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:22.975399 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:22.976008 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:22.982301 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:22.982753 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:22.983521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:22.983964 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:23.116898 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:23.124454 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-f64af21e-c433-4066-aa43-f97a39af4c33 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.152913 May 18 15:06:23.125091 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 504/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:22 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:24.142057 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:24.142679 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:24.149280 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:24.149721 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:24.150474 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:24.150909 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:24.298611 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:24.306480 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-b1a6b8ac-df48-4964-b701-f39429ebaa49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.168948 May 18 15:06:24.307059 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 497/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:24 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:25.323291 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:25.323856 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:25.330992 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:25.331658 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:25.332649 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:25.333098 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:25.464886 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:25.472421 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b2f5cf61-b313-4c92-b260-662269282a81 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.153070 May 18 15:06:25.473075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 505/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:25 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:26.490008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:26.490569 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:26.496969 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:26.497419 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:26.498191 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:26.498630 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:26.637687 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:26.645213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-05eaca5d-4959-4ac5-b6c9-507e68ee8ac8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.159169 May 18 15:06:26.645779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 498/1003] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:26 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:27.661929 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:27.662543 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:27.669020 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:27.669464 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:27.670222 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:27.670653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:27.807634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:27.815572 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2bc67026-167b-40e3-bd1a-ac3eb3b089f7 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.157344 May 18 15:06:27.816079 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 506/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:27 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:06:28.833262 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:28.833888 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:28.835900 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:28.836857 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=10 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:28.842698 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:28.843784 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:28.844553 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:28.845021 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:28.984096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:28.992281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9da2ff7c-a339-4c57-a904-bcff802112b3 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.163582 May 18 15:06:28.993092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 499/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:28 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:30.009502 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:30.010124 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:30.017236 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:30.017702 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:30.018506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:30.018948 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:30.160413 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:30.168239 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-75b4adc7-011c-47bd-8b64-8b7868c91024 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.162573 May 18 15:06:30.168853 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 507/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:30 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:31.186125 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:31.187339 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:31.193889 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:31.194338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:31.195106 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:31.195543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:31.331153 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:31.338580 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d29e52a2-a9b4-4d02-80ba-84d339ce768a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.156343 May 18 15:06:31.339138 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 500/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:31 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:32.321372 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-fe3baf0d-e468-4e03-93dd-b648e1cc910c req-3b188a50-1cf4-4e82-bce1-2245f5c7332b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366e5a82-fcc6-43b2-bee6-18a102900b29", "name": "network-vif-plugged", "status": "completed", "tag": "9a2aa193-61d5-49e1-874d-e6b962c370c9"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:32.330158 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-fe3baf0d-e468-4e03-93dd-b648e1cc910c req-3b188a50-1cf4-4e82-bce1-2245f5c7332b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:32.330604 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-fe3baf0d-e468-4e03-93dd-b648e1cc910c req-3b188a50-1cf4-4e82-bce1-2245f5c7332b service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:32.342552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-fe3baf0d-e468-4e03-93dd-b648e1cc910c req-3b188a50-1cf4-4e82-bce1-2245f5c7332b service nova] Creating event network-vif-plugged:9a2aa193-61d5-49e1-874d-e6b962c370c9 for instance 366e5a82-fcc6-43b2-bee6-18a102900b29 on hv-cinder-83998 May 18 15:06:32.348199 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-fe3baf0d-e468-4e03-93dd-b648e1cc910c req-3b188a50-1cf4-4e82-bce1-2245f5c7332b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030532 May 18 15:06:32.350488 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 508/1008] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:06:32.356027 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:32.356660 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:32.364032 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:32.364480 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:32.365272 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:32.365809 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:32.498511 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:32.507008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-caeea576-6785-4f26-bc9c-de0a0853e341 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.155199 May 18 15:06:32.507586 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 501/1009] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:32 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:33.525171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:33.525806 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:33.532764 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:33.533225 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:33.534004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:33.534451 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:33.661975 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:33.669395 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3f2d1c93-0612-469b-b51e-4fd5053a1310 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1266 microversion: 2.1 time: 0.148993 May 18 15:06:33.669998 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 509/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:33 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:34.687435 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:34.688075 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:34.694661 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:34.695106 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:34.695870 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:34.696303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:34.828566 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:34.836392 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7eec628a-38a0-403d-b3da-d37fbe188838 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1452 microversion: 2.1 time: 0.153523 May 18 15:06:34.836997 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 502/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:34 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:34.853521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:34.854068 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:34.860416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:34.860900 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:34.861657 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:34.862090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:34.992654 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:06:35.001151 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-1beb8224-4cd1-4d8c-a2a3-978e12b998c2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1452 microversion: 2.1 time: 0.151528 May 18 15:06:35.001732 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 510/1012] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:06:34 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:06:36.001330 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd1344d0-552d-4e58-8ba1-eb2c8e7f96cd", "device": "/dev/sdb"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:36.002998 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:36.009416 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:36.009868 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:36.010635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:36.011098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:36.273739 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1928a782-7f55-4287-a9d2-d5c1306a24d2 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "POST /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276886 May 18 15:06:36.274593 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 503/1013] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:06:35 2022] POST /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:06:36.696104 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-2e94fa04-b480-4245-98c9-6d58b9cddc22 req-33e5581c-7f6b-42f4-b12a-24791e26a33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366e5a82-fcc6-43b2-bee6-18a102900b29", "tag": "9a2aa193-61d5-49e1-874d-e6b962c370c9"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:06:36.704084 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2e94fa04-b480-4245-98c9-6d58b9cddc22 req-33e5581c-7f6b-42f4-b12a-24791e26a33d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:36.704528 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-2e94fa04-b480-4245-98c9-6d58b9cddc22 req-33e5581c-7f6b-42f4-b12a-24791e26a33d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:36.715266 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-2e94fa04-b480-4245-98c9-6d58b9cddc22 req-33e5581c-7f6b-42f4-b12a-24791e26a33d service nova] Creating event network-changed:9a2aa193-61d5-49e1-874d-e6b962c370c9 for instance 366e5a82-fcc6-43b2-bee6-18a102900b29 on hv-cinder-83998 May 18 15:06:36.720615 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-2e94fa04-b480-4245-98c9-6d58b9cddc22 req-33e5581c-7f6b-42f4-b12a-24791e26a33d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089502 May 18 15:06:36.721249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 511/1014] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:06:59.927802 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:59.928561 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:59.933058 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:06:59.933641 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:06:59.941693 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:59.942141 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:06:59.942901 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:06:59.943353 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:00.023173 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lazy-loading 'services' on Instance uuid 134d1a43-f6e9-481b-891c-d9af293d39b3 {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:07:00.096005 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-356a9a96-a6da-411f-bce7-d5e9ecf926eb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3/os-volume_attachments/fd1344d0-552d-4e58-8ba1-eb2c8e7f96cd" status: 202 len: 0 microversion: 2.1 time: 0.169471 May 18 15:07:00.096807 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 504/1015] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:06:59 2022] DELETE /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3/os-volume_attachments/fd1344d0-552d-4e58-8ba1-eb2c8e7f96cd => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:07:01.209757 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:01.210482 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=92 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:01.215075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:01.215662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:01.223054 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:01.223497 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:01.224258 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:01.224728 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:01.250672 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:07:01.323135 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-c6824e82-96f0-4bda-a14c-b35f846bdb78 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 204 len: 0 microversion: 2.1 time: 0.114547 May 18 15:07:01.323881 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 512/1016] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:07:01 2022] DELETE /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:07:01.332598 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:01.333336 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:01.339966 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:01.340420 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:01.341217 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:01.342285 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:01.475276 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:01.482739 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-e535599b-7801-4239-9e2e-fcc7b78fb1c3 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1514 microversion: 2.1 time: 0.154414 May 18 15:07:01.483304 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 505/1017] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:01 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:02.500679 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:02.501295 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:02.507771 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:02.508220 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:02.509016 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:02.509457 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:02.636272 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:02.644270 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-3fc67a0a-55e3-42aa-80e4-15e455af3104 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1514 microversion: 2.1 time: 0.148576 May 18 15:07:02.644875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 513/1018] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:02 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:03.623735 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-d79e978a-01db-4438-a7ab-082a3e918914 req-122a60cf-a6ab-4b2c-80c3-1af31708936d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134d1a43-f6e9-481b-891c-d9af293d39b3", "name": "network-vif-deleted", "tag": "50595964-603e-4437-8916-b082496f51bb"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:07:03.632162 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-d79e978a-01db-4438-a7ab-082a3e918914 req-122a60cf-a6ab-4b2c-80c3-1af31708936d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:03.632623 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-d79e978a-01db-4438-a7ab-082a3e918914 req-122a60cf-a6ab-4b2c-80c3-1af31708936d service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:03.644376 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-d79e978a-01db-4438-a7ab-082a3e918914 req-122a60cf-a6ab-4b2c-80c3-1af31708936d service nova] Creating event network-vif-deleted:50595964-603e-4437-8916-b082496f51bb for instance 134d1a43-f6e9-481b-891c-d9af293d39b3 on hv-cinder-83998 May 18 15:07:03.649303 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-d79e978a-01db-4438-a7ab-082a3e918914 req-122a60cf-a6ab-4b2c-80c3-1af31708936d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029902 May 18 15:07:03.649957 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 506/1019] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:07:03.660461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:03.661120 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:03.667634 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:03.668084 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:03.668885 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:03.669331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:03.733487 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:03.741134 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ae0fccb1-7cc2-4be1-9cba-d631dfcb4c08 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 200 len: 1304 microversion: 2.1 time: 0.084799 May 18 15:07:03.741707 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 514/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:03 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:04.760404 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:04.761126 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: 134d1a43-f6e9-481b-891c-d9af293d39b3] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:04.767761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:04.768204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:04.768984 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:04.769423 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:04.782875 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] HTTP exception thrown: Instance 134d1a43-f6e9-481b-891c-d9af293d39b3 could not be found. May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Request method failure captured: May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 HTTP/1.1 May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQtemlr5pbwbxcm5R1uaYnakyomY9AM3wuacEscWioxuXZbG6-5WW7xW4QnaNaH_qfKglsn1Sl420I3Rc7iQD_urtQE3HbeTEMhxfm1r-UJcKYj3bF4NUcYbqELODmgWxgpVbp8FcPvyVux0c-lGjcKREvIpxCLPI-zJH_ChBdRLsIg May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: 00895e40e4484304937344779ff6f048 May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967604929 May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:07:04.784457 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/00895e40e4484304937344779ff6f048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/00895e40e4484304937344779ff6f048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/00895e40e4484304937344779ff6f048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_00895e40e4484304937344779ff6f048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-VolumesSnapshotTestJSON-967604929 May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: 00895e40e4484304937344779ff6f048 May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967604929 May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-VolumesSnapshotTestJSON-967604929-project May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: b1fcf616a6f543a9898c3ed755131d03 May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-VolumesSnapshotTestJSON-967604929-project May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 134d1a43-f6e9-481b-891c-d9af293d39b3 could not be found. May 18 15:07:04.786239 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '134d1a43-f6e9-481b-891c-d9af293d39b3'} May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134d1a43-f6e9-481b-891c-d9af293d39b3 could not be found. May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:07:04.787230 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134d1a43-f6e9-481b-891c-d9af293d39b3 could not be found. May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134d1a43-f6e9-481b-891c-d9af293d39b3 could not be found. May 18 15:07:04.788574 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:07:04.789883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Returning 404 to user: Instance 134d1a43-f6e9-481b-891c-d9af293d39b3 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:07:04.789883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-2bd09bf8-14bd-4648-aa36-f1e51bf522fb tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3" status: 404 len: 111 microversion: 2.1 time: 0.030172 May 18 15:07:04.789883 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 507/1021] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:04 2022] GET /compute/v2.1/servers/134d1a43-f6e9-481b-891c-d9af293d39b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:07:13.728494 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1006738791", "imageRef": "bf620499-76dd-4566-a333-b4add0c57a86", "flavorRef": "452", "networks": [{"uuid": "af259da3-6954-4c7e-8bc3-5252f5783ea7"}]}} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:07:13.736207 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:13.738166 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:13.781440 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.network.neutron [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] validate_networks() for [('af259da3-6954-4c7e-8bc3-5252f5783ea7', None, None, None, None, None)] {{(pid=123864) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 15:07:14.119477 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Flavor limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 15:07:14.119906 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Image limits 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 15:07:14.120388 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Flavor pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 15:07:14.120831 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Image pref 0:0:0 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 15:07:14.121267 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.virt.hardware [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 15:07:14.129945 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:14.130397 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:14.131196 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:14.131635 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:14.148951 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Getting quotas for project 00895e40e4484304937344779ff6f048. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 15:07:14.152722 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.quota [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Getting quotas for user b1fcf616a6f543a9898c3ed755131d03 and project 00895e40e4484304937344779ff6f048. Resources: {'instances', 'cores', 'ram'} {{(pid=123864) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 15:07:14.163827 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Going to run 1 instances... {{(pid=123864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 15:07:14.166075 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf620499-76dd-4566-a333-b4add0c57a86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 15:07:14.211266 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-0fcd0daf-020e-496a-a278-b37deb2fdca0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486559 May 18 15:07:14.212090 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 515/1022] 10.222.0.59 () {60 vars in 1146 bytes} [Wed May 18 15:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 15:07:14.221752 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-f1285e77-6587-49c8-b025-1482cdb1489a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:14.222358 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-f1285e77-6587-49c8-b025-1482cdb1489a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:14.279487 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-f1285e77-6587-49c8-b025-1482cdb1489a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:14.286299 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-f1285e77-6587-49c8-b025-1482cdb1489a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1219 microversion: 2.1 time: 0.068357 May 18 15:07:14.287304 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 508/1023] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:14 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:15.304048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:15.305056 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:15.314406 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:15.314887 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:15.315701 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:15.316138 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:15.387171 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:15.395326 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-52c979cd-1acf-4df0-85bc-a6f5517499e5 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1277 microversion: 2.1 time: 0.095730 May 18 15:07:15.395892 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 516/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:15 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:16.413946 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:16.414654 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:16.416864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:16.424848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:16.425298 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:16.426074 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:16.426500 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:16.497965 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-ea7806f9-c9a7-47fd-b417-d38346537539 req-4dd26c3b-60c2-4dde-9b76-292960841e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd6a23e-73bf-4f73-9759-8aac29ccb4bd", "tag": "ffb82972-8629-441d-81fd-c2a47a13d4df"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:07:16.506840 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ea7806f9-c9a7-47fd-b417-d38346537539 req-4dd26c3b-60c2-4dde-9b76-292960841e33 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:16.507283 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-ea7806f9-c9a7-47fd-b417-d38346537539 req-4dd26c3b-60c2-4dde-9b76-292960841e33 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:16.522369 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-ea7806f9-c9a7-47fd-b417-d38346537539 req-4dd26c3b-60c2-4dde-9b76-292960841e33 service nova] Creating event network-changed:ffb82972-8629-441d-81fd-c2a47a13d4df for instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd on hv-cinder-83998 May 18 15:07:16.527286 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-ea7806f9-c9a7-47fd-b417-d38346537539 req-4dd26c3b-60c2-4dde-9b76-292960841e33 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033569 May 18 15:07:16.528078 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 517/1025] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:07:16.675628 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:16.683370 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-8f5565f2-2afa-4d97-89cb-8af9bfc9573a tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.273767 May 18 15:07:16.683936 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 509/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:16 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:17.702269 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:17.702965 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:17.709304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:17.709754 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:17.710517 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:17.710954 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:17.920343 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:17.927712 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-10ab4bb2-cd3d-4916-9496-246e6cdc68c0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.230606 May 18 15:07:17.928280 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 518/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:17 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:18.945039 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:18.945653 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:18.952633 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:18.953087 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:18.953848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:18.954281 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:19.091796 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:19.099210 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-ea6e31ac-45f2-4d37-9017-87aac52395ef tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.158046 May 18 15:07:19.099771 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 510/1028] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:18 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:20.116331 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:20.116957 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:20.123719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:20.124178 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:20.124986 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:20.125431 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:20.256268 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:20.263646 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-95120187-131b-4f77-b2bc-b64804fd1c21 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.151199 May 18 15:07:20.264211 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 519/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:20 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:21.280304 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:21.281578 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:21.288240 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:21.288758 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:21.289554 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:21.290016 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:21.417418 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:21.425272 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-44e2bf31-51d4-4b37-b992-c176f0166d6f tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.148881 May 18 15:07:21.425826 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 511/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:21 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:22.442176 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:22.442772 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:22.449185 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:22.449627 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:22.450410 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:22.450822 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:22.547083 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-12b67f67-65de-46e1-b328-4b26bd0bc4f6 req-cf0ff88d-6e96-4002-b4ec-a4fbcdb1e37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd6a23e-73bf-4f73-9759-8aac29ccb4bd", "name": "network-vif-plugged", "status": "completed", "tag": "ffb82972-8629-441d-81fd-c2a47a13d4df"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:07:22.556389 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-12b67f67-65de-46e1-b328-4b26bd0bc4f6 req-cf0ff88d-6e96-4002-b4ec-a4fbcdb1e37a service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:22.557466 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-12b67f67-65de-46e1-b328-4b26bd0bc4f6 req-cf0ff88d-6e96-4002-b4ec-a4fbcdb1e37a service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:22.569998 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-12b67f67-65de-46e1-b328-4b26bd0bc4f6 req-cf0ff88d-6e96-4002-b4ec-a4fbcdb1e37a service nova] Creating event network-vif-plugged:ffb82972-8629-441d-81fd-c2a47a13d4df for instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd on hv-cinder-83998 May 18 15:07:22.575968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-12b67f67-65de-46e1-b328-4b26bd0bc4f6 req-cf0ff88d-6e96-4002-b4ec-a4fbcdb1e37a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 May 18 15:07:22.576681 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 512/1031] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 15:07:22.584387 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:22.593010 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-505b3a3f-e05c-4019-bd99-1e4692e2effd tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.154794 May 18 15:07:22.593708 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 520/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:22 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:23.610872 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:23.611480 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:23.617730 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:23.618187 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:23.618923 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:23.619355 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:23.747824 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:23.755157 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-aa7fab90-7862-4750-8c4a-f53c408a1d0c tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1319 microversion: 2.1 time: 0.149031 May 18 15:07:23.755712 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 513/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:23 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:24.772575 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:24.773243 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:24.775201 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=2 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:24.775838 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell0:SELECT=6 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:24.782368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:24.782814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:24.783572 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:24.784005 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:24.914240 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:24.922165 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-4ce9fbd1-108b-4e1b-935b-56bebbba6d9b tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1508 microversion: 2.1 time: 0.153552 May 18 15:07:24.922737 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 521/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:24 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:24.939551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d3e33b2-28e0-44c2-99aa-8055871b0964", "device": "/dev/sdb"}} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:07:24.940722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:24.942803 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell0:SELECT=2 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:24.948551 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:24.949025 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:24.949787 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:24.950772 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:25.031366 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:07:25.031598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Wed May 18 15:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:07:25.206777 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-9a3dcf05-181b-4607-9d28-c9aebddf7828 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "POST /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271659 May 18 15:07:25.211774 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 514/1035] 10.222.0.59 () {60 vars in 1322 bytes} [Wed May 18 15:07:24 2022] POST /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:07:44.482273 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:44.482758 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:44.485241 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:44.485984 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=34 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:44.491565 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:44.492014 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:44.492812 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:44.493249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:44.572958 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.objects.instance [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lazy-loading 'services' on Instance uuid dbd6a23e-73bf-4f73-9759-8aac29ccb4bd {{(pid=123864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:07:44.647925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2f3323df-9ff0-46cb-9b44-222b94ddcfe9 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd/os-volume_attachments/1d3e33b2-28e0-44c2-99aa-8055871b0964" status: 202 len: 0 microversion: 2.1 time: 0.169374 May 18 15:07:44.648705 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 522/1036] 10.222.0.59 () {58 vars in 1415 bytes} [Wed May 18 15:07:44 2022] DELETE /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd/os-volume_attachments/1d3e33b2-28e0-44c2-99aa-8055871b0964 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 15:07:45.759549 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=24 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:45.760358 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:45.764886 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:45.765475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:45.773378 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:45.773830 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:45.774597 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:45.775034 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:45.801417 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:07:45.876179 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-d1d63520-b4ae-4100-a905-6a5efa9ef6be tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 204 len: 0 microversion: 2.1 time: 0.117802 May 18 15:07:45.877225 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 515/1037] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:07:45 2022] DELETE /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:07:45.885791 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:45.886506 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:45.893942 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:45.894400 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:45.895173 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:45.895617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:46.026155 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:46.033717 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-5c599471-30a3-483e-a16f-6e142666b9a0 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1514 microversion: 2.1 time: 0.152146 May 18 15:07:46.034281 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 523/1038] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:45 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:47.051896 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:47.052612 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:47.059557 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:47.060011 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:47.060852 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:47.061293 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:47.190935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:47.198475 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6123505f-ee76-48f2-83d2-01025d3a2fa7 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1514 microversion: 2.1 time: 0.150885 May 18 15:07:47.199063 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 516/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:47 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:48.036936 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-e54d2725-2dea-46d3-81bb-ba45cd1dcd64 req-da036303-63e2-4576-8d89-30a4a0a5d8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd6a23e-73bf-4f73-9759-8aac29ccb4bd", "name": "network-vif-deleted", "tag": "ffb82972-8629-441d-81fd-c2a47a13d4df"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:07:48.045875 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-e54d2725-2dea-46d3-81bb-ba45cd1dcd64 req-da036303-63e2-4576-8d89-30a4a0a5d8c2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:48.046323 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-e54d2725-2dea-46d3-81bb-ba45cd1dcd64 req-da036303-63e2-4576-8d89-30a4a0a5d8c2 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:48.057552 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-e54d2725-2dea-46d3-81bb-ba45cd1dcd64 req-da036303-63e2-4576-8d89-30a4a0a5d8c2 service nova] Creating event network-vif-deleted:ffb82972-8629-441d-81fd-c2a47a13d4df for instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd on hv-cinder-83998 May 18 15:07:48.062394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-e54d2725-2dea-46d3-81bb-ba45cd1dcd64 req-da036303-63e2-4576-8d89-30a4a0a5d8c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029110 May 18 15:07:48.062991 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 524/1040] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:07:48.216114 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:48.216754 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:48.223599 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:48.224098 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:48.224950 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:48.225413 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:48.259080 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:48.259531 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:48.259983 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.objects.instance [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lazy-loading 'fault' on Instance uuid dbd6a23e-73bf-4f73-9759-8aac29ccb4bd {{(pid=123865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 15:07:48.304207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fcf616a6f543a9898c3ed755131d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00895e40e4484304937344779ff6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:07:48.312676 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-07db54b7-8437-42f2-8737-fe92eb1b01f8 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 200 len: 1309 microversion: 2.1 time: 0.101237 May 18 15:07:48.313233 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 517/1041] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:48 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:07:49.330908 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:07:49.331732 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] [instance: dbd6a23e-73bf-4f73-9759-8aac29ccb4bd] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:07:49.338073 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:49.338520 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:49.339284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:07:49.339719 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:07:49.353398 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] HTTP exception thrown: Instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd could not be found. May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Request method failure captured: May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd HTTP/1.1 May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQtemlr5pbwbxcm5R1uaYnakyomY9AM3wuacEscWioxuXZbG6-5WW7xW4QnaNaH_qfKglsn1Sl420I3Rc7iQD_urtQE3HbeTEMhxfm1r-UJcKYj3bF4NUcYbqELODmgWxgpVbp8FcPvyVux0c-lGjcKREvIpxCLPI-zJH_ChBdRLsIg May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: 00895e40e4484304937344779ff6f048 May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967604929 May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:07:49.355023 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/00895e40e4484304937344779ff6f048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/00895e40e4484304937344779ff6f048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/00895e40e4484304937344779ff6f048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_00895e40e4484304937344779ff6f048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-VolumesSnapshotTestJSON-967604929 May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: 00895e40e4484304937344779ff6f048 May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967604929 May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-VolumesSnapshotTestJSON-967604929-project May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: b1fcf616a6f543a9898c3ed755131d03 May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-VolumesSnapshotTestJSON-967604929-project May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd could not be found. May 18 15:07:49.357129 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': 'dbd6a23e-73bf-4f73-9759-8aac29ccb4bd'} May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd could not be found. May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:07:49.358170 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd could not be found. May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd could not be found. May 18 15:07:49.360004 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:07:49.361461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] Returning 404 to user: Instance dbd6a23e-73bf-4f73-9759-8aac29ccb4bd could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:07:49.361461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-abb83d34-3e71-4836-9236-eb8ce5bb2846 tempest-VolumesSnapshotTestJSON-967604929 tempest-VolumesSnapshotTestJSON-967604929-project] 10.222.0.59 "GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd" status: 404 len: 111 microversion: 2.1 time: 0.031056 May 18 15:07:49.361461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 525/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:07:49 2022] GET /compute/v2.1/servers/dbd6a23e-73bf-4f73-9759-8aac29ccb4bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:08:16.936172 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:16.936764 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:16.938607 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [req-90fa9629-6601-4b2d-a504-2a02cc5f5928 req-fdbc4100-6f14-4e92-a12c-dc720f534caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366e5a82-fcc6-43b2-bee6-18a102900b29", "tag": "9a2aa193-61d5-49e1-874d-e6b962c370c9"}]} {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:08:16.939366 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:16.940087 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG dbcounter [-] [123865] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:16.944416 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_api:SELECT=8 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:16.945617 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG dbcounter [-] [123864] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=123864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:16.949290 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:16.950309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:16.950931 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-90fa9629-6601-4b2d-a504-2a02cc5f5928 req-fdbc4100-6f14-4e92-a12c-dc720f534caf service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:16.951206 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:16.951412 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [req-90fa9629-6601-4b2d-a504-2a02cc5f5928 req-fdbc4100-6f14-4e92-a12c-dc720f534caf service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:16.951782 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:16.964538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.compute.server_external_events [req-90fa9629-6601-4b2d-a504-2a02cc5f5928 req-fdbc4100-6f14-4e92-a12c-dc720f534caf service nova] Creating event network-changed:9a2aa193-61d5-49e1-874d-e6b962c370c9 for instance 366e5a82-fcc6-43b2-bee6-18a102900b29 on hv-cinder-83998 May 18 15:08:16.970394 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [req-90fa9629-6601-4b2d-a504-2a02cc5f5928 req-fdbc4100-6f14-4e92-a12c-dc720f534caf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035671 May 18 15:08:16.971306 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 526/1043] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:08:16.982927 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Going to try to terminate instance {{(pid=123865) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:08:17.062588 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-1bad7f9e-337f-4355-b161-ef8ba577bd2b tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "DELETE /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 204 len: 0 microversion: 2.1 time: 0.130117 May 18 15:08:17.063094 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 518/1044] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:08:16 2022] DELETE /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:08:17.073423 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:17.075007 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:17.082115 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:17.082571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:17.083348 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:17.083792 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:17.218550 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:17.226368 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-ddd6c811-f455-459f-876f-e9741b44c9cb tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1577 microversion: 2.1 time: 0.158516 May 18 15:08:17.226934 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 527/1045] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:17 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:18.244989 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:18.245694 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:18.252167 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:18.252683 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:18.253526 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:18.253968 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:18.385525 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:18.392974 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-66ea0d23-5a67-47e4-ada4-01c37c782a0e tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1577 microversion: 2.1 time: 0.152231 May 18 15:08:18.393544 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 519/1046] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:18 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:19.410108 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:19.410723 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:19.417931 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:19.418380 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:19.419144 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:19.419582 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:19.550304 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:19.558725 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-a56ad704-7a8e-44f5-b631-70f8d15bcc66 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1577 microversion: 2.1 time: 0.152463 May 18 15:08:19.559296 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 528/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:19 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:20.575470 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:20.576092 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:20.583372 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:20.583827 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:20.584640 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:20.585093 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:20.722213 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:20.729779 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-6b39f41a-c0ae-4c05-81b2-24009c851480 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1577 microversion: 2.1 time: 0.158273 May 18 15:08:20.730348 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 520/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:20 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:21.746485 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:21.747142 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:21.753831 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:21.754284 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:21.755059 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:21.755571 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:21.888047 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:21.895968 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-936c6247-11e2-45f6-ac68-ea60caf48f49 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1577 microversion: 2.1 time: 0.153886 May 18 15:08:21.896626 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 529/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:21 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:22.559789 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-1a0b37fd-ff85-4058-adfe-b307a36047c1 req-f47896a2-cc7c-4d53-be3c-314a799ba7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366e5a82-fcc6-43b2-bee6-18a102900b29", "name": "network-vif-deleted", "tag": "9a2aa193-61d5-49e1-874d-e6b962c370c9"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:08:22.568647 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1a0b37fd-ff85-4058-adfe-b307a36047c1 req-f47896a2-cc7c-4d53-be3c-314a799ba7d7 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:22.569145 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-1a0b37fd-ff85-4058-adfe-b307a36047c1 req-f47896a2-cc7c-4d53-be3c-314a799ba7d7 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:22.580163 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-1a0b37fd-ff85-4058-adfe-b307a36047c1 req-f47896a2-cc7c-4d53-be3c-314a799ba7d7 service nova] Creating event network-vif-deleted:9a2aa193-61d5-49e1-874d-e6b962c370c9 for instance 366e5a82-fcc6-43b2-bee6-18a102900b29 on hv-cinder-83998 May 18 15:08:22.586407 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-1a0b37fd-ff85-4058-adfe-b307a36047c1 req-f47896a2-cc7c-4d53-be3c-314a799ba7d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030844 May 18 15:08:22.587207 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 521/1050] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:08:22.914169 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:22.914791 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:22.921513 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:22.922263 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:22.923048 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:22.923480 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:22.987521 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:22.996330 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-30ccb4b0-a383-4f33-a631-3ffabf435703 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 200 len: 1225 microversion: 2.1 time: 0.085965 May 18 15:08:23.007405 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 530/1051] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:22 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:24.018935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:24.019674 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 366e5a82-fcc6-43b2-bee6-18a102900b29] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:24.026386 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:24.026836 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:24.027606 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:24.028054 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:24.043060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] HTTP exception thrown: Instance 366e5a82-fcc6-43b2-bee6-18a102900b29 could not be found. May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Request method failure captured: May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 HTTP/1.1 May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQpOrMeXdgjXnx-10TUre6G0hAr52PXfa0UxhTUinrdNcJuZTZ_YBmz4V8siA4YoFHqIO5bKA1M-JkUlQMLty5NgVelZToHQtmtqr0QaaWQ7Enp9t6D7jzaSF-HgJCMbxPHzNQwn7lbyb7B7pa5yYc6nJwpm_KHrCQNNhV2A_PgEk-Q May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:08:24.045004 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: b1a4f9ee8de446fe989b4d91ea0315e8 May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 366e5a82-fcc6-43b2-bee6-18a102900b29 could not be found. May 18 15:08:24.046722 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '366e5a82-fcc6-43b2-bee6-18a102900b29'} May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366e5a82-fcc6-43b2-bee6-18a102900b29 could not be found. May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:08:24.047692 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366e5a82-fcc6-43b2-bee6-18a102900b29 could not be found. May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366e5a82-fcc6-43b2-bee6-18a102900b29 could not be found. May 18 15:08:24.049451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:24.050887 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Returning 404 to user: Instance 366e5a82-fcc6-43b2-bee6-18a102900b29 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:08:24.050887 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-7466caf7-02a7-4cc4-a3b8-6323a0da3bf2 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29" status: 404 len: 111 microversion: 2.1 time: 0.032233 May 18 15:08:24.050887 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 522/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:24 2022] GET /compute/v2.1/servers/366e5a82-fcc6-43b2-bee6-18a102900b29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:08:29.204102 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-6f13ef45-5208-4deb-9a9e-8a53e1f64cf6 req-12e8a404-da2e-45f9-a7ea-a740ed69cec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19720ba-f060-4b0c-9f92-bfe6dd401d8c", "tag": "d606525d-ae8c-4f8f-bf39-230c02f71e29"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:08:29.205930 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:29.206444 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:29.213470 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:29.214017 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:29.214814 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:29.215258 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:29.219724 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-6f13ef45-5208-4deb-9a9e-8a53e1f64cf6 req-12e8a404-da2e-45f9-a7ea-a740ed69cec8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:29.220171 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-6f13ef45-5208-4deb-9a9e-8a53e1f64cf6 req-12e8a404-da2e-45f9-a7ea-a740ed69cec8 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:29.239272 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-6f13ef45-5208-4deb-9a9e-8a53e1f64cf6 req-12e8a404-da2e-45f9-a7ea-a740ed69cec8 service nova] Creating event network-changed:d606525d-ae8c-4f8f-bf39-230c02f71e29 for instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c on hv-cinder-83998 May 18 15:08:29.246053 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-6f13ef45-5208-4deb-9a9e-8a53e1f64cf6 req-12e8a404-da2e-45f9-a7ea-a740ed69cec8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044688 May 18 15:08:29.247850 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Going to try to terminate instance {{(pid=123864) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 15:08:29.250761 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 523/1053] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:08:29.346466 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-62abe64c-5e22-4ebe-ac30-1af4a51afa67 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 204 len: 0 microversion: 2.1 time: 0.148108 May 18 15:08:29.347653 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 531/1054] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:08:29 2022] DELETE /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 15:08:29.357790 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:29.358488 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:29.365295 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:29.365744 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:29.366543 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:29.366976 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:29.512060 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.policy [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123865) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:29.519947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-55887ecd-b431-4d77-bff2-9fbac1c136d5 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1578 microversion: 2.1 time: 0.167819 May 18 15:08:29.520635 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 524/1055] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:29 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 15:08:30.539959 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:30.540925 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:30.549593 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:30.550050 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:30.550864 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:30.551309 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:30.689348 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:30.696889 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-9b2767d3-e427-4360-8b65-bbcbafb96381 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1578 microversion: 2.1 time: 0.162527 May 18 15:08:30.697461 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 532/1056] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:30 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:31.510146 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [req-2baa511e-5818-4c36-8444-7706a06f1f6b req-c137b8d1-fbd9-43b5-acd8-95b9c7b19324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19720ba-f060-4b0c-9f92-bfe6dd401d8c", "name": "network-vif-deleted", "tag": "d606525d-ae8c-4f8f-bf39-230c02f71e29"}]} {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 15:08:31.521208 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-2baa511e-5818-4c36-8444-7706a06f1f6b req-c137b8d1-fbd9-43b5-acd8-95b9c7b19324 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:31.521568 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [req-2baa511e-5818-4c36-8444-7706a06f1f6b req-c137b8d1-fbd9-43b5-acd8-95b9c7b19324 service nova] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:31.534204 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.compute.server_external_events [req-2baa511e-5818-4c36-8444-7706a06f1f6b req-c137b8d1-fbd9-43b5-acd8-95b9c7b19324 service nova] Creating event network-vif-deleted:d606525d-ae8c-4f8f-bf39-230c02f71e29 for instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c on hv-cinder-83998 May 18 15:08:31.539338 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [req-2baa511e-5818-4c36-8444-7706a06f1f6b req-c137b8d1-fbd9-43b5-acd8-95b9c7b19324 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033227 May 18 15:08:31.540109 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 525/1057] 10.222.0.59 () {64 vars in 1317 bytes} [Wed May 18 15:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 15:08:31.713419 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:31.714662 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:31.721088 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:31.721537 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:31.722305 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:31.722742 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:32.066528 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.policy [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a4f9ee8de446fe989b4d91ea0315e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f3dc5d9c6648c79267f71b5a86f249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123864) authorize /opt/stack/nova/nova/policy.py:199}} May 18 15:08:32.074587 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-2014261d-226a-4c3e-9eaa-33a2efef8cc8 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 200 len: 1226 microversion: 2.1 time: 0.365093 May 18 15:08:32.075146 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 533/1058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:31 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 1226 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 15:08:33.092284 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:33.093008 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: b19720ba-f060-4b0c-9f92-bfe6dd401d8c] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:33.099121 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:33.099572 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:33.100355 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:33.100947 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:33.114073 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] HTTP exception thrown: Instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c could not be found. May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Request method failure captured: May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c HTTP/1.1 May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQpOrMeXdgjXnx-10TUre6G0hAr52PXfa0UxhTUinrdNcJuZTZ_YBmz4V8siA4YoFHqIO5bKA1M-JkUlQMLty5NgVelZToHQtmtqr0QaaWQ7Enp9t6D7jzaSF-HgJCMbxPHzNQwn7lbyb7B7pa5yYc6nJwpm_KHrCQNNhV2A_PgEk-Q May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:08:33.115695 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: b1a4f9ee8de446fe989b4d91ea0315e8 May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c could not be found. May 18 15:08:33.117492 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': 'b19720ba-f060-4b0c-9f92-bfe6dd401d8c'} May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c could not be found. May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:08:33.118469 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c could not be found. May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c could not be found. May 18 15:08:33.120648 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.122793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Returning 404 to user: Instance b19720ba-f060-4b0c-9f92-bfe6dd401d8c could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:08:33.122793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-24511f41-553f-4dbc-bac4-d405f6a55be9 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c" status: 404 len: 111 microversion: 2.1 time: 0.029529 May 18 15:08:33.122793 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 526/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:33 2022] GET /compute/v2.1/servers/b19720ba-f060-4b0c-9f92-bfe6dd401d8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:08:33.626514 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:33.627175 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.compute.api [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123864) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:33.634833 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:33.635873 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:33.637091 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:33.637538 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG oslo_concurrency.lockutils [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:33.654536 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.wsgi [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] HTTP exception thrown: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Request method failure captured: May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: request: DELETE /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 HTTP/1.1 May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept: application/json May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Accept-Encoding: identity May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Connection: close May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Length: 0 May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Content-Type: application/json May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Host: 10.222.0.59 May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Openstack-System-Scope: None May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: User-Agent: python-urllib3/1.26.9 May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Auth-Token: gAAAAABihQpOrMeXdgjXnx-10TUre6G0hAr52PXfa0UxhTUinrdNcJuZTZ_YBmz4V8siA4YoFHqIO5bKA1M-JkUlQMLty5NgVelZToHQtmtqr0QaaWQ7Enp9t6D7jzaSF-HgJCMbxPHzNQwn7lbyb7B7pa5yYc6nJwpm_KHrCQNNhV2A_PgEk-Q May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Id: None May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Domain-Name: None May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Identity-Status: Confirmed May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Is-Admin-Project: True May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Id: default May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Domain-Name: Default May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Project-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Role: reader,member May 18 15:08:33.656216 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Roles: reader,member May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Id: default May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Domain-Name: Default May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Id: b1a4f9ee8de446fe989b4d91ea0315e8 May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: X-User-Name: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: method: > May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: exception: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.657767 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: action_args: {'id': '2e4414a5-96ca-43e6-beba-c0892c513802'} May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:08:33.658555 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.660436 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: ERROR nova.api.openstack.wsgi May 18 15:08:33.662680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Returning 404 to user: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. {{(pid=123864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:08:33.662680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-7383f1ea-78c6-4670-842e-fda262c0245a tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 404 len: 111 microversion: 2.1 time: 0.036858 May 18 15:08:33.662680 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 534/1060] 10.222.0.59 () {58 vars in 1238 bytes} [Wed May 18 15:08:33 2022] DELETE /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 15:08:33.666193 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '>' {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:33.666848 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.compute.api [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] [instance: 2e4414a5-96ca-43e6-beba-c0892c513802] Fetching instance by UUID {{(pid=123865) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 15:08:33.673344 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:33.673797 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:33.674592 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 15:08:33.675707 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG oslo_concurrency.lockutils [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Lock "7aee4120-6738-4344-ac0e-c12b2bd21945" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 15:08:33.690343 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.wsgi [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] HTTP exception thrown: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Request method failure captured: May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: request: GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 HTTP/1.1 May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept: application/json May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Accept-Encoding: identity May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Connection: close May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Length: 0 May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Content-Type: application/json May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Host: 10.222.0.59 May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Openstack-System-Scope: None May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: User-Agent: python-urllib3/1.26.9 May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Auth-Token: gAAAAABihQpOrMeXdgjXnx-10TUre6G0hAr52PXfa0UxhTUinrdNcJuZTZ_YBmz4V8siA4YoFHqIO5bKA1M-JkUlQMLty5NgVelZToHQtmtqr0QaaWQ7Enp9t6D7jzaSF-HgJCMbxPHzNQwn7lbyb7B7pa5yYc6nJwpm_KHrCQNNhV2A_PgEk-Q May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Id: None May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Domain-Name: None May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Identity-Status: Confirmed May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Is-Admin-Project: True May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Id: default May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Domain-Name: Default May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Project-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Role: reader,member May 18 15:08:33.691864 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Roles: reader,member May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2f3dc5d9c6648c79267f71b5a86f249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Id: d2f3dc5d9c6648c79267f71b5a86f249 May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-Tenant-Name: tempest-TestVolumeBootPattern-1571635726 May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Id: default May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Domain-Name: Default May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Id: b1a4f9ee8de446fe989b4d91ea0315e8 May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: X-User-Name: tempest-TestVolumeBootPattern-1571635726-project May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: method: > May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: exception: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.693309 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: action_args: {'id': '2e4414a5-96ca-43e6-beba-c0892c513802'} May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: {{(pid=123865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 15:08:33.694096 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. May 18 15:08:33.695327 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: ERROR nova.api.openstack.wsgi May 18 15:08:33.696452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: DEBUG nova.api.openstack.wsgi [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Returning 404 to user: Instance 2e4414a5-96ca-43e6-beba-c0892c513802 could not be found. {{(pid=123865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 15:08:33.696452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO nova.api.openstack.requestlog [None req-02b1ee9e-7e57-49e1-8649-c7b3a33d8798 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802" status: 404 len: 111 microversion: 2.1 time: 0.030889 May 18 15:08:33.696452 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: [pid: 123865|app: 0|req: 527/1061] 10.222.0.59 () {58 vars in 1235 bytes} [Wed May 18 15:08:33 2022] GET /compute/v2.1/servers/2e4414a5-96ca-43e6-beba-c0892c513802 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 15:08:34.988136 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: DEBUG nova.api.openstack.wsgi [None req-b13fcb0e-d522-4945-b37d-ae2a45de0101 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] Calling method '.version_select at 0x7fa8a082cd30>' {{(pid=123864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 15:08:35.009425 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO nova.api.openstack.requestlog [None req-b13fcb0e-d522-4945-b37d-ae2a45de0101 tempest-TestVolumeBootPattern-1571635726 tempest-TestVolumeBootPattern-1571635726-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782896207" status: 202 len: 0 microversion: 2.1 time: 0.025036 May 18 15:08:35.010006 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: [pid: 123864|app: 0|req: 535/1062] 10.222.0.59 () {58 vars in 1262 bytes} [Wed May 18 15:08:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782896207 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 15:09:03.263696 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:09:03.264156 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Wed May 18 15:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:10:33.221935 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:10:33.222535 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Wed May 18 15:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:10:59.113091 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:10:59.113683 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Wed May 18 15:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:11:02.912523 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:11:02.914702 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Wed May 18 15:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:12:23.271961 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:12:23.272451 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Wed May 18 15:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:12:31.002970 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:12:31.003598 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Wed May 18 15:12:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:13:53.231244 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:13:53.231705 dv-cinder-839987-7-iscsi devstack@n-api.service[123865]: Wed May 18 15:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 15:14:05.044651 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 15:14:05.045249 dv-cinder-839987-7-iscsi devstack@n-api.service[123864]: Wed May 18 15:14:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!